Hybrid feature selection method for supervised classification based on Laplacian score ranking

  • Authors:
  • Saúl Solorio-Fernández;J. Ariel Carrasco-Ochoa;José Fco. Martínez-Trinidad

  • Affiliations:
  • National Institute for Astrophysics, Optics and Electronics, Puebla, Mexico;National Institute for Astrophysics, Optics and Electronics, Puebla, Mexico;National Institute for Astrophysics, Optics and Electronics, Puebla, Mexico

  • Venue:
  • MCPR'10 Proceedings of the 2nd Mexican conference on Pattern recognition: Advances in pattern recognition
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we introduce a new hybrid filter-wrapper method for supervised feature selection, based on the Laplacian Score ranking combined with a wrapper strategy. We propose to rank features with the Laplacian Score to reduce the search space, and then we use this order to find the best feature subset. We compare our method against other based on ranking feature selection methods, namely, Information Gain Attribute Ranking, Relief, Correlation-based Feature Selection, and additionally we include in our comparison a Wrapper Subset Evaluation method. Empirical results over ten real-world datasets from the UCI repository show that our hybrid method is competitive and outperforms in most of the cases to the other feature selection methods used in our experiments.