Mutual Information Based Initialization of Forward-Backward Search for Feature Selection in Regression Problems

  • Authors:

  • Alberto Guillén;Antti Sorjamaa;Gines Rubio;Amaury Lendasse;Ignacio Rojas

  • Affiliations:

  • Department of Informatics, University of Jaen, Spain;Department of Computer Architecture and Technology, University of Granada, Spain;Department of Information and Computer Science, Helsinki University of Technology, Finland;Department of Computer Architecture and Technology, University of Granada, Spain;Department of Information and Computer Science, Helsinki University of Technology, Finland

  • Venue:
  • ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part I
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Pure feature selection, where variables are chosen or not to be in the training data set, still remains as an unsolved problem, especially when the dimensionality is high. Recently, the Forward-Backward Search algorithm using the Delta Test to evaluate a possible solution was presented, showing a good performance. However, due to the locality of the search procedure, the initial starting point of the search becomes crucial in order to obtain good results. This paper presents new heuristics to find a more adequate starting point that could lead to a better solution. The heuristic is based on the sorting of the variables using the Mutual Information criterion, and then performing parallel local searches. These local searches provide an initial starting point for the actual parallel Forward-Backward algorithm.