Ensemble approaches of support vector machines for multiclass classification

  • Authors:
  • Jun-Ki Min;Jin-Hyuk Hong;Sung-Bae Cho

  • Affiliations:
  • Department of Computer Science, Yonsei University, Biometrics Engineering Research Center, Seoul, Korea;Department of Computer Science, Yonsei University, Biometrics Engineering Research Center, Seoul, Korea;Department of Computer Science, Yonsei University, Biometrics Engineering Research Center, Seoul, Korea

  • Venue:
  • PReMI'07 Proceedings of the 2nd international conference on Pattern recognition and machine intelligence
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Support vector machine (SVM) which was originally designed for binary classification has achieved superior performance in various classification problems. In order to extend it to multiclass classification, one popular approach is to consider the problem as a collection of binary classification problems. Majority voting or winner-takes-all is then applied to combine those outputs, but it often causes problems to consider tie-breaks and tune the weights of individual classifiers. This paper presents two novel ensemble approaches: probabilistic ordering of one-vs-rest (OVR) SVMs with naïve Bayes classifier and multiple decision templates of OVR SVMs. Experiments with multiclass datasets have shown the usefulness of the ensemble methods.