Boosting in Linear Discriminant Analysis

  • Authors:
  • Marina Skurichina;Robert P. W. Duin

  • Affiliations:
  • -;-

  • Venue:
  • MCS '00 Proceedings of the First International Workshop on Multiple Classifier Systems
  • Year:
  • 2000

Quantified Score

Hi-index 0.04

Visualization

Abstract

In recent years, together with bagging [5] and the random subspace method [15], boosting [6] became one of the most popular combining techniques that allows us to improve a weak classifier. Usually, boosting is applied to Decision Trees (DT's). In this paper, we study boosting in Linear Discriminant Analysis (LDA). Simulation studies, carried out for one artificial data set and two real data sets, show that boosting might be useful in LDA for large training sample sizes while bagging is useful for critical training sample sizes [11]. In this paper, in contrast to a common opinion, we demonstrate that the usefulness of boosting does not depend on the instability of a classifier.