Pattern recognition via projection-based kNN rules

  • Authors:
  • Ricardo Fraiman;Ana Justel;Marcela Svarc

  • Affiliations:
  • Departamento de Matemática y Ciencias, Universidad de San Andrés, Argentina and CMAT, Universidad de la República, Uruguay;Departamento de Matemáticas, Universidad Autónoma de Madrid, Spain;Departamento de Matemática y Ciencias, Universidad de San Andrés, Argentina

  • Venue:
  • Computational Statistics & Data Analysis
  • Year:
  • 2010

Quantified Score

Hi-index 0.04

Visualization

Abstract

A new procedure for pattern recognition is introduced based on the concepts of random projections and nearest neighbors. It can be considered as an improvement of the classical nearest neighbor classification rules. Besides the concept of neighbors, the notion of district, a larger set into which the data will be projected, is introduced. Then a one-dimensional kNN method is applied to the projected data on randomly selected directions. This method, which is more accurate to handle high-dimensional data, has some robustness properties. The procedure is also universally consistent. Moreover, the method is challenged with the Isolet data set where a very high classification score is obtained.