On selecting interacting features from high-dimensional data

  • Authors:
  • Peter Hall;Jing-Hao Xue

  • Affiliations:
  • Department of Mathematics and Statistics, The University of Melbourne, VIC 3010, Australia;Department of Statistical Science, University College London, London WC1E 6BT, UK

  • Venue:
  • Computational Statistics & Data Analysis
  • Year:
  • 2014

Quantified Score

Hi-index 0.03

Visualization

Abstract

For high-dimensional data, most feature-selection methods, such as SIS and the lasso, involve ranking and selecting features individually. These methods do not require many computational resources, but they ignore feature interactions. A simple recursive approach, which, without requiring many more computational resources, also allows identification of interactions, is investigated. This approach can lead to substantial improvements in the performance of classifiers, and can provide insight into the way in which features work together in a given population. It also enjoys attractive statistical properties.