Kernel Approaches to Unsupervised and Supervised Machine Learning

  • Authors:
  • Sun-Yuan Kung

  • Affiliations:
  • Department of Electrical Engineering, Princeton University,

  • Venue:
  • PCM '09 Proceedings of the 10th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the kernel approach, any N vectorial or non-vectorial data can be converted to N vectors with feature dimension N. The promise of the kernel approach hinges upon its representation vector space, leading to a "cornerized" data structure. Furthermore, the nonsingular kernel matrix basically assures a theoretically linear separability, critical to supervised learning. The main results are two folds: In terms of unsupervised clustering, the kernel approach allows dimension reduction in the spectral space and, moreover, a simple error analysis for the fast kernel K-means. As to supervised classification, by imposing uncorrelated perturbation to the training vector in the spectral space, a perturbed (Fisher) discriminant analysis (PDA) is proposed. This ultimately leads to a hybrid classier which includes PDA and SVM as specials cases, thus offering more flexibility for improving the prediction performance.