Feature Kernel Functions: Improving SVMs Using High-Level Knowledge

  • Authors:
  • Qiang Sun;Gerald DeJong

  • Affiliations:
  • University of Illinois at Urbana-Champaign;University of Illinois at Urbana-Champaign

  • Venue:
  • CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Kernel functions are often cited as a mechanism to encode prior knowledge of a learning task. But it can be difficult to capture prior knowledge effectively. For example, we know that image pixels of a handwritten character result from a few strokes from a single writing implement; it is not clear how to express this in a kernel function. We investigate an Explanation Based Learning (EBL) paradigm to generate specialized kernel functions. These embody novel high-level features that are automatically constructed from the interaction of prior knowledge and training examples. Our empirical results showed that the performance of the resulting SVM surpasses that of a conventional SVM on the challenging task of classifying handwritten Chinese characters.