Feature selection based on loss-margin of nearest neighbor classification

  • Authors:
  • Yun Li;Bao-Liang Lu

  • Affiliations:
  • Institute of Computer Technology, Nanjing University of Posts and Telecommunications, 66 Xinmofan Rd, Nanjing 210003, P.R. China;Department of Computer Science and Engineering, Shanghai Jiao Tong University, 800 Dongchuan Rd, Shanghai 200240, P.R. China

  • Venue:
  • Pattern Recognition
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

The problem of selecting a subset of relevant features is classic and found in many branches of science including-examples in pattern recognition. In this paper, we propose a new feature selection criterion based on low-loss nearest neighbor classification and a novel feature selection algorithm that optimizes the margin of nearest neighbor classification through minimizing its loss function. At the same time, theoretical analysis based on energy-based model is presented, and some experiments are also conducted on several benchmark real-world data sets and facial data sets for gender classification to show that the proposed feature selection method outperforms other classic ones.