Multi-Classification by Using Tri-Class SVM

  • Authors:
  • Cecilio Angulo;Francisco J. Ruiz;Luis González;Juan Antonio Ortega

  • Affiliations:
  • Grup de Recerca en Enginyeria del Coneixement, Universitat Politècnica de Catalunya, Vilanova i la Geltrú, Spain 08800;Grup de Recerca en Enginyeria del Coneixement, Universitat Politècnica de Catalunya, Vilanova i la Geltrú, Spain 08800;Departamento de Economía Aplicada I, Universidad de Sevilla, Sevilla, Spain 41018;Escuela Técnica Superior de Ingeniería Informática, Universidad de Sevilla, Sevilla, Spain 41012

  • Venue:
  • Neural Processing Letters
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The standard form for dealing with multi-class classification problems when bi-classifiers are used is to consider a two-phase (decomposition, reconstruction) training scheme. The most popular decomposition procedures are pairwise coupling (one versus one, 1-v-1), which considers a learning machine for each Pair of classes, and the one-versus-all scheme (one versus all, 1-v-r), which takes into consideration each class versus the remaining classes. In this article a 1-v-1 tri-class Support Vector Machine (SVM) is presented. The expansion of the architecture of this machine into three categories specifically addresses the decomposition problem of how to prevent the loss of information which occurs in the usual 1-v-1 training procedure. The proposed machine, by means of a third class, allows all the information to be incorporated into the remaining training patterns when a multi-class problem is considered in the form of a 1-v-1 decomposition. Three general structures are presented where each improves some features from the precedent structure. In order to deal with multi-classification problems, it is demonstrated that the final machine proposed allows ordinal regression as a form of decomposition procedure. Examples and experimental results are presented which illustrate the performance of the new tri-class SV machine.