Fast neighborhood component analysis

  • Authors:
  • Wei Yang;Kuanquan Wang;Wangmeng Zuo

  • Affiliations:
  • Biocomputing Research Centre, School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China and School of Computer and Information Engineering, HeNan University, ...;Biocomputing Research Centre, School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China;Biocomputing Research Centre, School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China

  • Venue:
  • Neurocomputing
  • Year:
  • 2012

Quantified Score

Hi-index 0.01

Visualization

Abstract

Distance metric is of considerable importance in varieties of machine learning and pattern recognition applications. Neighborhood component analysis (NCA), one of the most successful metric learning algorithms, suffers from the high computational cost, which makes it only suitable for small-scale classification tasks. To overcome this disadvantage, we proposed a fast neighborhood component analysis (FNCA) method. For a given sample, FNCA adopts a local probability distribution model constructed based on its K nearest neighbors from the same class and from the different classes. We further extended FNCA to nonlinear metric learning scenarios using the kernel trick. Experimental results show that, compared with NCA, FNCA not only significantly increases the training speed but also obtains higher classification accuracy. Furthermore, comparative studies with the state-of-the-art approaches on various real-world datasets also verify the effectiveness of the proposed linear and nonlinear FNCA methods.