A Relationship Between Generalization Error and Training Samples in Kernel Regressors

  • Authors:
  • Akira Tanaka;Hideyuki Imai;Mineichi Kudo;Masaaki Miyakoshi

  • Affiliations:
  • -;-;-;-

  • Venue:
  • ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
  • Year:
  • 2010
  • Localized projection learning

    SSPR&SPR'10 Proceedings of the 2010 joint IAPR international conference on Structural, syntactic, and statistical pattern recognition

Quantified Score

Hi-index 0.00

Visualization

Abstract

A relationship between generalization error and training samples in kernel regressors is discussed in this paper. The generalization error can be decomposed into two components. One is a distance between an unknown true function and an adopted model space. The other is a distance between an estimated function and the orthogonal projection of the unknown true function onto the model space. In our previous work, we gave a framework to evaluate the first component. In this paper, we theoretically analyze the second one and show that a larger set of training samples usually causes a larger generalization error.