Evolutionary search of optimal features

  • Authors:
  • Manuel del Valle;Luis F. Lago-Fernández;Fernando J. Corbacho

  • Affiliations:
  • Escuela Politécnica Superior, Universidad Autónoma de Madrid, Madrid, Spain;Escuela Politécnica Superior, Universidad Autónoma de Madrid, Madrid, Spain;Escuela Politécnica Superior, Universidad Autónoma de Madrid, Madrid, Spain

  • Venue:
  • IDEAL'06 Proceedings of the 7th international conference on Intelligent Data Engineering and Automated Learning
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In data mining problems, the selection of appropriate input transformations is often crucial to obtain good solutions. The purpose of such transformations is to project the original attribute space onto a new one that, being closer to the problem structure, allows for more compact and interpretable solutions. We address the problem of automatic construction of input transformations in classification problems. We use an evolutionary approach to search the space of input transformations and a linear method to perform classification on the new feature space. Our assumption is that once a proper data representation, which captures the problem structure, is found, even a linear classifier may find a good solution. Linear methods are free from local minima, while the use of a representation space closer to the problem structure will in general provide more compact and interpretable solutions. We test our method using an artificial problem and a real classification problem from the UCI database. In both cases we obtain low error solutions that in addition are compact and interpretable.