Comparison of a Novel Combined ECOC Strategy with Different Multiclass Algorithms Together with Parameter Optimization Methods

  • Authors:
  • Marco Hülsmann;Christoph M. Friedrich

  • Affiliations:
  • Universität zu Köln, Germany and Fraunhofer-Institute for Algorithms and Scientific Computing (SCAI), Schloß, Birlinghoven, 53754 Sankt Augustin, Germany;Fraunhofer-Institute for Algorithms and Scientific Computing (SCAI), Schloß, Birlinghoven, 53754 Sankt Augustin, Germany

  • Venue:
  • MLDM '07 Proceedings of the 5th international conference on Machine Learning and Data Mining in Pattern Recognition
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we consider multiclass learning tasks based on Support Vector Machines (SVMs). In this regard, currently used methods are One-Against-Allor One-Against-One, but there is much need for improvements in the field of multiclass learning. We developed a novel combination algorithm called Comb-ECOC, which is based on posterior class probabilities. It assigns, according to the Bayesian rule, the respective instance to the class with the highest posterior probability. A problem with the usage of a multiclass method is the proper choice of parameters. Many users only take the default parameters of the respective learning algorithms (e.g. the regularization parameter Cand the kernel parameter 茂戮驴). We tested different parameter optimization methods on different learning algorithms and confirmed the better performance of One-Against-Oneversus One-Against-All, which can be explained by the maximum margin approach of SVMs.