Linear dimensionality reduction by maximizing the Chernoff distance in the transformed space

  • Authors:
  • Luis Rueda;Myriam Herrera

  • Affiliations:
  • Department of Computer Science, University of Concepción, Edmundo Larenas 215, Concepción 4030000, Chile;Institute of Informatics, National University of San Juan, Cereceto y Meglioli, San Juan 5400, Argentina

  • Venue:
  • Pattern Recognition
  • Year:
  • 2008

Quantified Score

Hi-index 0.01

Visualization

Abstract

Linear dimensionality reduction (LDR) techniques are quite important in pattern recognition due to their linear time complexity and simplicity. In this paper, we present a novel LDR technique which, though linear, aims to maximize the Chernoff distance in the transformed space; thus, augmenting the class separability in such a space. We present the corresponding criterion, which is maximized via a gradient-based algorithm, and provide convergence and initialization proofs. We have performed a comprehensive performance analysis of our method combined with two well-known classifiers, linear and quadratic, on synthetic and real-life data, and compared it with other LDR techniques. The results on synthetic and standard real-life data sets show that the proposed criterion outperforms the latter when combined with both linear and quadratic classifiers.