Chernoff-Based Multi-class Pairwise Linear Dimensionality Reduction

  • Authors:
  • Luis Rueda;Claudio Henríquez;B. John Oommen

  • Affiliations:
  • School of Computer Science, University of Windsor, Windsor, Canada N9P 3P4;Department of Computer Science, University of Concepción, Concepción, Chile 4070409;School of Computer Science, Carleton University, Ottawa, Canada K1S 5B6

  • Venue:
  • CIARP '08 Proceedings of the 13th Iberoamerican congress on Pattern Recognition: Progress in Pattern Recognition, Image Analysis and Applications
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Linear dimensionality reduction techniques have been studied very well for the two-class problem, while the corresponding issues encountered when dealing with multiple classes are far from trivial. In this paper, we show that dealing with multiple classes, it is not expedient to treat it as a multi-class problem, but it is better to treat it as an ensemble of Chernoff-based two-class reductions onto different subspaces. The solution is achieved by resorting to either Voting, Weighting, or a Decision Treecombination scheme. The ensemble methods were tested on benchmark datasets demonstrating that the proposed method is not only efficient, but also yields an accuracy comparable to that obtained by the optimal Bayes classifier.