A fractal dimension based filter algorithm to select features for supervised learning

  • Authors:
  • Huei Diana Lee;Maria Carolina Monard;Feng Chung Wu

  • Affiliations:
  • Laboratory of Computational Intelligence – LABIC, University of São Paulo – USP, Institute of Mathematics and Computer Science – ICMC, São Carlos, SP, Brazil;Laboratory of Computational Intelligence – LABIC, University of São Paulo – USP, Institute of Mathematics and Computer Science – ICMC, São Carlos, SP, Brazil;Laboratory of Computational Intelligence – LABIC, University of São Paulo – USP, Institute of Mathematics and Computer Science – ICMC, São Carlos, SP, Brazil

  • Venue:
  • IBERAMIA-SBIA'06 Proceedings of the 2nd international joint conference, and Proceedings of the 10th Ibero-American Conference on AI 18th Brazilian conference on Advances in Artificial Intelligence
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Feature selection plays an important role in machine learning and is often applied as a data pre-processing step. Its objective is to choose a subset from the original set of features that describes a data set, according to some importance criterion, by removing irrelevant and/or redundant features, as they may decrease data quality and reduce the comprehensibility of hypotheses induced by supervised learning algorithms. Most of the state-of-art feature selection algorithms mainly focus on finding relevant features. However, it has been shown that relevance alone is not sufficient to select important features. It is also important to deal with the problem of features’ redundancy. For the purpose of selecting features and discarding others, it is necessary to measure the features’ goodness (importance), and many importance measures have been proposed. This work proposes a filter algorithm that decouples relevance and redundancy analysis, and introduces the use of Fractal Dimension to deal with redundant features. Empirical results on several data sets show that Fractal Dimension is an appropriate criterion to filter out redundant features for supervised learning.