Heteroscedastic linear feature extraction based on sufficiency conditions

Authors:
Mohammad Shahin Mahanta;Amirhossein S. Aghaei;Konstantinos N. Plataniotis;Subbarayan Pasupathy
Affiliations:
Department of Electrical and Computer Engineering, University of Toronto, 10 King's College Road, Toronto, ON, Canada M5S 3G4;Department of Electrical and Computer Engineering, University of Toronto, 10 King's College Road, Toronto, ON, Canada M5S 3G4;Department of Electrical and Computer Engineering, University of Toronto, 10 King's College Road, Toronto, ON, Canada M5S 3G4;Department of Electrical and Computer Engineering, University of Toronto, 10 King's College Road, Toronto, ON, Canada M5S 3G4
Venue:
Pattern Recognition
Year:
2012

Citing 13
Cited 2

Introduction to statistical pattern recognition (2nd ed.)

Introduction to statistical pattern recognition (2nd ed.)
Heteroscedastic discriminant analysis and reduced rank HMMs for improved speech recognition

Speech Communication
Statistical Pattern Recognition: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fractional-Step Dimensionality Reduction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiclass Linear Dimension Reduction by Weighted Pairwise Fisher Criteria

IEEE Transactions on Pattern Analysis and Machine Intelligence
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Linear Dimensionality Reduction via a Heteroscedastic Extension of LDA: The Chernoff Criterion

IEEE Transactions on Pattern Analysis and Machine Intelligence
A test for the equality of covariance matrices when the dimension is large relative to the sample sizes

Computational Statistics & Data Analysis
Approximate information discriminant analysis: A computationally simple heteroscedastic feature extraction technique

Pattern Recognition
Bayes Optimality in Linear Discriminant Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Linear dimensionality reduction by maximizing the Chernoff distance in the transformed space

Pattern Recognition
Multi-class pairwise linear dimensionality reduction using heteroscedastic schemes

Pattern Recognition
On the minimal dimension of sufficient statistics

IEEE Transactions on Information Theory

The C-loss function for pattern classification

Pattern Recognition
Review article: Computational intelligence techniques in bioinformatics

Computational Biology and Chemistry

Quantified Score

Hi-index	0.01

Visualization

Abstract

Classification of high-dimensional data typically requires extraction of discriminant features. This paper proposes a linear feature extractor, called whitened linear sufficient statistic (WLSS), which is based on the sufficiency conditions for heteroscedastic Gaussian distributions. WLSS approximates, in the least squares sense, an operator providing a sufficient statistic. The proposed method retains covariance discriminance in heteroscedastic data, while it reduces to the commonly used linear discriminant analysis (LDA) in the homoscedastic case. Compared to similar heteroscedastic methods, WLSS imposes a low computational complexity, and is highly generalizable as confirmed by its consistent competence over various data sets.