Simplify decision function of reduced support vector machines

  • Authors:
  • Yuangui Li;Weidong Zhang;Guoli Wang;Yunze Cai

  • Affiliations:
  • Department of Automation, Shanghai Jiaotong University, Shanghai, P. R. China;Department of Automation, Shanghai Jiaotong University, Shanghai, P. R. China;Department of Electronic and Communication Engineering, School of Information Science and Technology, Sun Yat-Sen University, Guangzhou, P.R. China;Department of Automation, Shanghai Jiaotong University, Shanghai, P. R. China

  • Venue:
  • MICAI'05 Proceedings of the 4th Mexican international conference on Advances in Artificial Intelligence
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Reduced Support Vector Machines (RSVM) was proposed as the alternate of standard support vector machines (SVM) in order to resolve the difficulty in the learning of nonlinear SVM for large data set problems. RSVM preselects a subset as support vectors and solves a smaller optimization problem, and it performs well with remarkable efficiency on training of SVM for large problem. All the training points of the subset will be support vectors, and more training points are selected into this subset results in high possibility to obtain RSVM with better generalization ability. So we first obtain the RSVM with more support vectors, and selects out training examples near classification hyper plane. Then only these training examples are used as training set to obtain a standard SVM with less support vector than that of RSVM. Computational results show that standard SVMs on the basis of RSVM have much less support vectors and perform equal generalization ability to that of RSVM.