Mixing linear SVMs for nonlinear classification

  • Authors:
  • Zhouyu Fu;Antonio Robles-Kelly;Jun Zhou

  • Affiliations:
  • Gippsland School of Information Technology, Monash University, Victoria, Australia and Australian National University, Canberra ACT, Australia;National Information and Communications Technology Australia and the College of Engineering and Computer Science, Australian National University, Canberra ACT, Australia and University of New Sout ...;National Information and Communications Technology Australia and the College of Engineering and Computer Science, Australian National University, Canberra ACT, Australia and University of New Sout ...

  • Venue:
  • IEEE Transactions on Neural Networks
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we address the problem of combining linear support vector machines (SVMs) for classification of large-scale nonlinear datasets. The motivation is to exploit both the efficiency of linear SVMs (LSVMs) in learning and prediction and the power of nonlinear SVMs in classification. To this end, we develop a LSVM mixture model that exploits a divide-and-conquer strategy by partitioning the feature space into subregions of linearly separable datapoints and learning a LSVM for each of these regions. We do this implicitly by deriving a generative model over the joint data and label distributions. Consequently, we can impose priors on the mixing coefficients and do implicit model selection in a top-down manner during the parameter estimation process. This guarantees the sparsity of the learned model. Experimental results show that the proposed method can achieve the efficiency of LSVMs in the prediction phase while still providing a classification performance comparable to nonlinear SVMs.