Inverse matrix-free incremental proximal support vector machine

  • Authors:
  • Zhenfeng Zhu;Xingquan Zhu;Yuefei Guo;Yangdong Ye;Xiangyang Xue

  • Affiliations:
  • School of Information Engineering, Zhengzhou University, 100 Kexue Road, Zhengzhou 450001, PR China;QCIS Center, Faculty of Engineering & Information Technology, University of Technology, Sydney, NSW 2007, Australia;School of Computer Science, Fudan University, 220 Handan Road, Shanghai 200433, PR China;School of Information Engineering, Zhengzhou University, 100 Kexue Road, Zhengzhou 450001, PR China;School of Computer Science, Fudan University, 220 Handan Road, Shanghai 200433, PR China

  • Venue:
  • Decision Support Systems
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Traditional Support Vector Machines (SVMs) based learners are commonly regarded as strong classifiers for many learning tasks. Their efficiency for large-scale high dimensional data, however, has shown to be unsatisfactory. Consequently, many alternative SVM solutions exist for large-scale and/or high dimensional data. Among them, proximal support vector machine (PSVM) is a simple but effective SVM classifier. Its incremental version (ISVM) is also available for large-scale data. Nevertheless, the computational efficiency of the ISVM for high dimensional data still needs to be improved, mainly because it requires explicit matrix inversion for updating the decision model. To solve this problem, we propose, in this paper, an inverse matrix-free incremental PSVM (IMISVM) with the following two characteristics. Firstly, IMISVM avoids explicit matrix inversion and hence derives simple formulas for updating model parameters. Secondly, IMISVM achieves faster convergence speed than ISVM. Experimental results on synthetic and real-world data sets confirm that the proposed incremental classifier outperforms ISVM.