Bootstrap feature selection for ensemble classifiers

  • Authors:
  • Rakkrit Duangsoithong;Terry Windeatt

  • Affiliations:
  • Center for Vision, Speech and Signal Processing, University of Surrey, Guildford, United Kingdom;Center for Vision, Speech and Signal Processing, University of Surrey, Guildford, United Kingdom

  • Venue:
  • ICDM'10 Proceedings of the 10th industrial conference on Advances in data mining: applications and theoretical aspects
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Small number of samples with high dimensional feature space leads to degradation of classifier performance for machine learning, statistics and data mining systems. This paper presents a bootstrap feature selection for ensemble classifiers to deal with this problem and compares with traditional feature selection for ensemble (select optimal features from whole dataset before bootstrap selected data). Four base classifiers: Multilayer Perceptron, Support Vector Machines, Naive Bayes and Decision Tree are used to evaluate the performance of UCI machine learning repository and causal discovery datasets. Bootstrap feature selection algorithm provides slightly better accuracy than traditional feature selection for ensemble classifiers.