New validation methods for improving standard and multi-parametric support vector regression training time

Authors:
J. Gascón-Moreno;S. Salcedo-Sanz;E. G. Ortiz-Garcıa;J. Acevedo-Rodrıguez;Jose A. Portilla-Figueras
Affiliations:
Department of Signal Theory and Communications, Universidad de Alcalá, Madrid, Spain;Department of Signal Theory and Communications, Universidad de Alcalá, Madrid, Spain;Department of Signal Theory and Communications, Universidad de Alcalá, Madrid, Spain;Department of Signal Theory and Communications, Universidad de Alcalá, Madrid, Spain;Department of Signal Theory and Communications, Universidad de Alcalá, Madrid, Spain
Venue:
Expert Systems with Applications: An International Journal
Year:
2012

Citing 13
Cited 0

Introduction to Evolutionary Computing

Introduction to Evolutionary Computing
Reducing examples to accelerate support vector regression

Pattern Recognition Letters
Model optimizing and feature selecting for support vector regression in time series forecasting

Neurocomputing
Support vector machines combined with feature selection for breast cancer diagnosis

Expert Systems with Applications: An International Journal
A Novel hybrid genetic algorithm for kernel function and parameter optimization in support vector regression

Expert Systems with Applications: An International Journal
Short-term fault prediction based on support vector machines with parameter optimization by evolution strategy

Expert Systems with Applications: An International Journal
Improving the training time of support vector regression algorithms through novel hyper-parameters search space reductions

Neurocomputing
Evolutionary tuning of multiple SVM parameters

Neurocomputing
Support Vector Regression for the simultaneous learning of a multivariate function and its derivatives

Neurocomputing
Reducing samples for accelerating multikernel semiparametric support vector regression

Expert Systems with Applications: An International Journal
Multikernel semiparametric linear programming support vector regression

Expert Systems with Applications: An International Journal
A fast method to approximately train hard support vector regression

Neural Networks
LIBSVM: A library for support vector machines

ACM Transactions on Intelligent Systems and Technology (TIST)

Quantified Score

Hi-index	12.05

Visualization

Abstract

The selection of hyper-parameters in support vector regression algorithms (SVMr) is an essential process in the training of these learning machines. Unfortunately, there is not an exact method to obtain the optimal values of SVMr hyper-parameters. Therefore, it is necessary to use a search algorithm and sometimes a validation method in order to find the best combination of hyper-parameters. The problem is that the SVMr training time can be huge in large training databases if standard search algorithms and validation methods (such as grid search and K-fold cross validation), are used. In this paper we propose two novel validation methods which reduce the SVMr training time, maintaining the accuracy of the final machine. We show the good performance of both methods in the standard SVMr with 3 hyper-parameters (where the hyper-parameters search is usually carried out by means of a grid search) and also in the extension to multi-parametric kernels, where meta-heuristic approaches such as evolutionary algorithms must be used to look for the best set of SVMr hyper-parameters. In all cases the new validation methods have provided very good results in terms of training time, without affecting the final SVMr accuracy.