K-local hyperplane distance nearest neighbor classifier oriented local discriminant analysis

  • Authors:
  • Jie Xu;Jian Yang;Zhihui Lai

  • Affiliations:
  • School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing 210094, PR China and Shaoguan University, School of Mathematics and Information Science, Guangdong ...;School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing 210094, PR China;The Bio-Computing Research Center, Shenzhen Graduate School, Harbin Institute of Technology, Shenzhen 518055, PR China

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 2013

Quantified Score

Hi-index 0.07

Visualization

Abstract

K-local hyperplane distance nearest neighbor (HKNN) classifier is an improved K-nearest neighbor (KNN) algorithm that has been successfully applied to pattern classification. This paper embeds the decision rule of HKNN classifier into the discriminant analysis model to develop a new feature extractor. The obtained feature extractor is called K-local hyperplane distance nearest neighbor classifier oriented local discriminant analysis (HOLDA), in which a regularization item is imposed on the original HKNN algorithm to obtain a more reliable distance metric. Based on this distance metric, the homo-class and hetero-class local scatters are characterized in HOLDA. By maximizing the ratio of the hetero-class local scatter to the homo-class local scatter, we obtain a subspace which is suitable for feature extraction and classification. In general, this paper provides a framework for building a feature extractor from the decision rule of a classifier. By this means, the feature extractor and classifier can be seamlessly integrated. Experimental results on four databases demonstrate that the integrated pattern recognition system is effective.