Feature subset selection in large dimensionality domains

  • Authors:
  • Iffat A. Gheyas;Leslie S. Smith

  • Affiliations:
  • Department of Computing Science and Mathematics, University of Stirling, Stirling, FK9 4LA, Scotland, UK;Department of Computing Science and Mathematics, University of Stirling, Stirling, FK9 4LA, Scotland, UK

  • Venue:
  • Pattern Recognition
  • Year:
  • 2010

Quantified Score

Hi-index 0.01

Visualization

Abstract

Searching for an optimal feature subset from a high dimensional feature space is known to be an NP-complete problem. We present a hybrid algorithm, SAGA, for this task. SAGA combines the ability to avoid being trapped in a local minimum of simulated annealing with the very high rate of convergence of the crossover operator of genetic algorithms, the strong local search ability of greedy algorithms and the high computational efficiency of generalized regression neural networks. We compare the performance over time of SAGA and well-known algorithms on synthetic and real datasets. The results show that SAGA outperforms existing algorithms.