Structural risk minimization using nearest neighbor rule

  • Authors:
  • A. B. Hamza;H. Krim;B. Karacali

  • Affiliations:
  • Dept. of Electr. & Comput. Eng., North Carolina State Univ., Raleigh, NC, USA;Dept. of Electr. & Comput. Eng., North Carolina State Univ., Raleigh, NC, USA;Dept. of Electr. & Comput. Eng., North Carolina State Univ., Raleigh, NC, USA

  • Venue:
  • ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel nearest neighbor rule-based implementation of the structural risk minimization principle to address a generic classification problem. We propose a fast reference set thinning algorithm on the training data set similar to a support vector machine approach. We then show that the nearest neighbor rule based on the reduced set implements the structural risk minimization principle, in a manner, which does not involve selection of a convenient feature space. Simulation results on real data indicate that this method significantly reduces the computational cost of the conventional support vector machines, and achieves a nearly comparable test error performance.