On the SVMpath initialization

  • Authors:
  • Jisheng Dai;Fei Mai

  • Affiliations:
  • School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013, China;Department of Electrical and Electronic Engineering, The University of Hong Kong, Pokfulam Road, Hong Kong

  • Venue:
  • Signal Processing
  • Year:
  • 2012

Quantified Score

Hi-index 0.08

Visualization

Abstract

This paper presents a novel algorithm for the initial configuration to the model selection problem in the two-class support vector machine (SVM) classification when fitting the entire path of SVM solutions for every value of the regularization parameter. Instead of using quadratic programming for initialization in the conventional two-class SVM regularization path fitting methods, we propose a piecewise linear method which reduces the computational cost significantly. Furthermore, an efficient treatment is provided to deal with the singular case where the data set contains linearly dependent points, duplicate points or nearly duplicate points. The performance of the proposed algorithm in terms of computational complexity and the ability to handle singular cases are backed by strict mathematical analysis and proof, and verified by the experimental results.