Hybrid feature selection: combining fisher criterion and mutual information for efficient feature selection

  • Authors:
  • Chandra Shekhar Dhir;Soo Young Lee

  • Affiliations:
  • Department of Bio and Brain Engineering and Brain Science Research Center, KAIST, Daejeon, Korea;Department of Bio and Brain Engineering and Department of Electrical Engineering and Computer Science and Brain Science Research Center, KAIST, Daejeon, Korea

  • Venue:
  • ICONIP'08 Proceedings of the 15th international conference on Advances in neuro-information processing - Volume Part I
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Low dimensional representation of multivariate data using unsupervised feature extraction is combined with a hybrid feature selection method to improve classification performance of recognition tasks. The proposed hybrid feature selector is applied to the union of feature subspaces selected by Fisher criterion and feature-class mutual information (MI). It scores each feature as a linear weighted sum of its interclass MI and Fisher criterion score. Proposed method efficiently selects features with higher class discrimination in comparison to feature-class MI, Fisher criterion or unsupervised selection using variance; thus, resulting in much improved recognition performance. In addition, the paper also highlights the use of MI between a feature and class as a computationally economical and optimal feature selector for statistically independent features.