Unsupervised Elimination of Redundant Features Using Genetic Programming

  • Authors:
  • Kourosh Neshatian;Mengjie Zhang

  • Affiliations:
  • School of Engineering and Computer Science, Victoria University of Wellington, Wellington, New Zealand;School of Engineering and Computer Science, Victoria University of Wellington, Wellington, New Zealand

  • Venue:
  • AI '09 Proceedings of the 22nd Australasian Joint Conference on Advances in Artificial Intelligence
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

While most feature selection algorithms focus on finding relevant features, few take the redundancy issue into account. We propose a nonlinear redundancy measure which uses genetic programming to find the redundancy quotient of a feature with respect to a subset of features. The proposed measure is unsupervised and works with unlabeled data. We introduce a forward selection algorithm which can be used along with the proposed measure to perform feature selection over the output of a feature ranking algorithm. The effectiveness of the proposed method is assessed by applying it to the output of the Chi-square (*** 2) feature ranker on a classification task. The results show significant improvements in the performance of decision tree and SVM classifiers.