A Thermodynamical Search Algorithm for Feature Subset Selection

  • Authors:
  • Félix F. González;Lluís A. Belanche

  • Affiliations:
  • Languages and Information Systems Department, Polytechnic University of Catalonia, Barcelona, Spain;Languages and Information Systems Department, Polytechnic University of Catalonia, Barcelona, Spain

  • Venue:
  • Neural Information Processing
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work tackles the problem of selecting a subset of featuresin an inductive learning setting, by introducing a novel Thermodynamic Feature Selection algorithm (TFS). Given a suitable objective function, the algorithm makes uses of a specially designed form of simulated annealingto find a subset of attributes that maximizes the objective function. The new algorithm is evaluated against one of the most widespread and reliable algorithms, the Sequential Forward Floating Search (SFFS). Our experimental results in classification tasks show that TFS achieves significant improvements over SFFS in the objective function with a notable reduction in subset size.