A vector-valued support vector machine model for multiclass problem

  • Authors:
  • Ran Wang;Sam Kwong;Degang Chen;Jingjing Cao

  • Affiliations:
  • Department of Computer Science, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong;Department of Computer Science, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong;Department of Mathematics and Physics, North China Electric Power University, 102206 Beijing, PR China;Department of Computer Science, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 2013

Quantified Score

Hi-index 0.07

Visualization

Abstract

In this paper, a new model named Multiclass Support Vector Machines with Vector-Valued Decision (M-SVMs-VVD) or VVD is proposed. The basic idea is to separate 2^a classes by a SVM hyperplanes in the feature space induced by certain kernels, where a is a finite positive integer. We start from a 2^a-class problem, and extend it to any-class problem by applying a hierarchical decomposition procedure. Compared with the existing SVM-based multiclass methods, the VVD model has two advantages. First, it reduces the computational complexity by using a small number of classifiers. Second, the feature space partition induced by the hyperplanes effectively eliminates the Unclassifiable regions (URs) that may affect the classification performance of the algorithm. Experimental comparisons with several state-of-the-art multiclass methods demonstrate that VVD maintains a comparable testing accuracy, while it improves the classification efficiency with less classifiers, a smaller number of support vectors (SVs), and shorter testing time.