Feature selection based on mutual correlation

  • Authors:
  • Michal Haindl;Petr Somol;Dimitrios Ververidis;Constantine Kotropoulos

  • Affiliations:
  • Academy of Sciences CR, Institute of Information Theory and Automation, Prague, Czech Republic;Academy of Sciences CR, Institute of Information Theory and Automation, Prague, Czech Republic;Dept. of Informatics, Aristotle Univ. of Thessaloniki, Thessaloniki, Greece;Dept. of Informatics, Aristotle Univ. of Thessaloniki, Thessaloniki, Greece

  • Venue:
  • CIARP'06 Proceedings of the 11th Iberoamerican conference on Progress in Pattern Recognition, Image Analysis and Applications
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Feature selection is a critical procedure in many pattern recognition applications. There are two distinct mechanisms for feature selection namely the wrapper methods and the filter methods. The filter methods are generally considered inferior to wrapper methods, however wrapper methods are computationally more demanding than filter methods. A novel filter feature selection method based on mutual correlation is proposed. We assess the classification performance of the proposed filter method by using the selected features to the Bayes classifier. Alternative filter feature selection methods that optimize either the Bhattacharrrya distance or the divergence are also tested. Furthermore, wrapper feature selection techniques employing several search strategies such as the sequential forward search, the oscillating search, and the sequential floating forward search are also included in the comparative study. A trade off between the classification accuracy and the feature set dimensionality is demonstrated on both two benchmark datasets from UCI repository and two emotional speech data collections.