A Meta-Learning Method to Select the Kernel Width in Support Vector Regression

  • Authors:
  • Carlos Soares;Pavel B. Brazdil;Petr Kuba

  • Affiliations:
  • LIACC/Faculty of Economics, University of Porto, Portugal. csoares@liacc.up.pt;LIACC/Faculty of Economics, University of Porto, Portugal. pbrazdil@liacc.up.pt;Masaryk University, Brno, Czech Republic. xkuba@informatics.muni.cz

  • Venue:
  • Machine Learning
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Support Vector Machine algorithm is sensitive to the choice of parameter settings. If these are not set correctly, the algorithm may have a substandard performance. Suggesting a good setting is thus an important problem. We propose a meta-learning methodology for this purpose and exploit information about the past performance of different settings. The methodology is applied to set the width of the Gaussian kernel. We carry out an extensive empirical evaluation, including comparisons with other methods (fixed default ranking; selection based on cross-validation and a heuristic method commonly used to set the width of the SVM kernel). We show that our methodology can select settings with low error while providing significant savings in time. Further work should be carried out to see how the methodology could be adapted to different parameter setting tasks.