Bagging and the Random Subspace Method for Redundant Feature Spaces

  • Authors:
  • Marina Skurichina;Robert P. W. Duin

  • Affiliations:
  • -;-

  • Venue:
  • MCS '01 Proceedings of the Second International Workshop on Multiple Classifier Systems
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

The performance of a single weak classifier can be improved by using combining techniques such as bagging, boosting and the random subspace method. When applying them to linear discriminant analysis, it appears that they are useful in different situations. Their performance is strongly affected by the choice of the base classifier and the training sample size. As well, their usefulness depends on the data distribution. In this paper, on the example of the pseudo Fisher linear classifier, we study the effect of the redundancy in the data feature set on the performance of the random subspace method and bagging.