Hierarchical Learning in Polynomial Support Vector Machines

  • Authors:
  • Sebastian Risau-Gusman;Mirta B. Gordon

  • Affiliations:
  • DRFMC/SPSMS CEA Grenoble, 17 av. des Martyrs 38054 Grenoble Cedex 09, France;DRFMC/SPSMS CEA Grenoble, 17 av. des Martyrs 38054 Grenoble Cedex 09, France

  • Venue:
  • Machine Learning
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We study the typical properties of polynomial Support Vector Machines within a Statistical Mechanics approach that takes into account the number of high order features relative to the input space dimension. We analyze the effect of different features' normalizations on the generalization error, for different kinds of learning tasks. If the normalization is adequately selected, hierarchical learning of features of increasing order takes place as a function of the training set size. Otherwise, the performance worsens, and there is no hierarchical learning at all.