Ensemble learning based on multi-task class labels

  • Authors:
  • Qing Wang;Liang Zhang

  • Affiliations:
  • ,School of Computer Science, Fudan University, Shanghai, China;School of Computer Science, Fudan University, Shanghai, China

  • Venue:
  • PAKDD'10 Proceedings of the 14th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part II
  • Year:
  • 2010

Quantified Score

Hi-index 0.01

Visualization

Abstract

It is well known that diversity among component classifiers is crucial for constructing a strong ensemble Most existing ensemble methods achieve this goal through resampling the training instances or input features Inspired by MTForest and AODE that enumerate each input attribute together with the class attribute to create different component classifiers in the ensemble In this paper, we propose a novel general ensemble method based on manipulating the class labels It generates different biased new class labels through the Cartesian product of the class attribute and each input attribute, and then builds a component classifier for each of them Extensive experiments, using decision tree and naive Bayes as base classifier respectively, show that the accuracy of our method is comparable to state-of-the-art ensemble methods Finally, the bias-variance decomposition results reveal that the success of our method mainly lies in that it can significantly reduce the bias of the base learner.