A feature selection technique for generation of classification committees and its application to categorization of laryngeal images

  • Authors:

  • M. Bacauskiene;A. Verikas;A. Gelzinis;D. Valincius

  • Affiliations:

  • Department of Applied Electronics, Kaunas University of Technology, Studentu 50, LT-51368 Kaunas, Lithuania;Department of Applied Electronics, Kaunas University of Technology, Studentu 50, LT-51368 Kaunas, Lithuania and Intelligent Systems Laboratory, Halmstad University, Box 823, S 301 18 Halmstad, Swe ...;Department of Applied Electronics, Kaunas University of Technology, Studentu 50, LT-51368 Kaunas, Lithuania;Department of Applied Electronics, Kaunas University of Technology, Studentu 50, LT-51368 Kaunas, Lithuania

  • Venue:
  • Pattern Recognition
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

This paper is concerned with a two phase procedure to select salient features (variables) for classification committees. Both filter and wrapper approaches to feature selection are combined in this work. In the first phase, definitely redundant features are eliminated based on the paired t-test. The test compares the saliency of the candidate and the noise features. In the second phase, the genetic search is employed. The search integrates the steps of training, aggregation of committee members, selection of hyper-parameters, and selection of salient features into the same learning process. A small number of genetic iterations needed to find a solution is the characteristic feature of the genetic search procedure developed. The experimental tests performed on five real-world problems have shown that significant improvements in classification accuracy can be obtained in a small number of iterations if compared to the case of using all the features available.