Linear Dependency between epsilon and the Input Noise in epsilon-Support Vector Regression

  • Authors:
  • James T. Kwok

  • Affiliations:
  • -

  • Venue:
  • ICANN '01 Proceedings of the International Conference on Artificial Neural Networks
  • Year:
  • 2001

Quantified Score

Hi-index 0.01

Visualization

Abstract

In using the Ɛ-support vector regression (Ɛ-SVR) algorithm, one has to decide on a suitable value of the insensitivity parameter Ɛ. Smola et al. [6] determined its "optimal" choice based on maximizing the statistical efficiency of a location parameter estimator. While they successfully predicted a linear scaling between the optimal Ɛ and the noise in the data, the value of the theoretically optimal Ɛ does not have a close match with its experimentally observed counterpart. In this paper, we attempt to better explain the experimental results there, by analyzing a toy problem with a closer setting to the Ɛ-SVR. Our resultant predicted choice of Ɛ is much closer to the experimentally observed value, while still demonstrating a linear trend with the data noise.