Can under-exploited structure of original-classes help ECOC-based multi-class classification?

  • Authors:
  • Yunyun Wang;Songcan Chen;Hui Xue

  • Affiliations:
  • School of Computer Science and Engineering, Nanjing University of Aeronautics & Astronautics, Nanjing 210016 , PR China;School of Computer Science and Engineering, Nanjing University of Aeronautics & Astronautics, Nanjing 210016 , PR China;School of Computer Science and Engineering, Southeast University, Nanjing 210096, PR China

  • Venue:
  • Neurocomputing
  • Year:
  • 2012

Quantified Score

Hi-index 0.01

Visualization

Abstract

Error correcting output codes (ECOC) is a popular framework for addressing multi-class classification problems by combing multiple binary sub-problems. In each binary sub-problem, at least one class is actually a ''meta-class'' consisting of multiple original classes, and treated as a single class in the learning process. This strategy brings a simple and common implementation of multi-class classification, but simultaneously, results in the under-exploitation of already-provided structure knowledge in individual original classes. In this paper, we present a new methodology to show that the utilization of such prior structure knowledge can further strengthen the performance of ECOCs, and the structure knowledge is formulated under the cluster and manifold assumptions, respectively. Finally, we validate our methodology on both toy and real benchmark datasets (UCI, face recognition and objective category), consequently validate the structure knowledge of individual original classes for ECOC-based multi-class classification.