Extending twin support vector machine classifier for multi-category classification problems

  • Authors:
  • Juanying Xie;Kate Hone;Weixin Xie;Xinbo Gao;Yong Shi;Xiaohui Liu

  • Affiliations:
  • School of Computer Science, Shaanxi Normal University, Xi'an, Shaanxi, China and School of Electronic Engineering, Xidian University, Xi'an, Shaanxi, China;School of Information Systems, Computing and Mathematics, Brunel University, London, UK;College of Information Engineering, Shenzhen University, Shenzhen, China;School of Electronic Engineering, Xidian University, Xi'an, Shaanxi, China;CAS Research Centre on Fictitious Economy and Data Science, Chinese Academy of Sciences, Beijing, China;School of Information Systems, Computing and Mathematics, Brunel University, London, UK

  • Venue:
  • Intelligent Data Analysis
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Twin support vector machine classifier TWSVM was proposed by Jayadeva et al., which was used for binary classification problems. TWSVM not only overcomes the difficulties in handling the problem of exemplar unbalance in binary classification problems, but also it is four times faster in training a classifier than classical support vector machines. This paper proposes one-versus-all twin support vector machine classifiers OVA-TWSVM for multi-category classification problems by utilizing the strengths of TWSVM. OVA-TWSVM extends TWSVM to solve k-category classification problems by developing k TWSVM where in the ith TWSVM, we only solve the Quadratic Programming Problems QPPs for the ith class, and get the ith nonparallel hyperplane corresponding to the ith class data. OVA-TWSVM uses the well known one-versus-all OVA approach to construct a corresponding twin support vector machine classifier. We analyze the efficiency of the OVA-TWSVM theoretically, and perform experiments to test its efficiency on both synthetic data sets and several benchmark data sets from the UCI machine learning repository. Both the theoretical analysis and experimental results demonstrate that OVA-TWSVM can outperform the traditional OVA-SVMs classifier. Further experimental comparisons with other multiclass classifiers demonstrated that comparable performance could be achieved.