Generalizing discriminant analysis using the generalized singular value decomposition

Authors:
P. Howland;H. Park
Affiliations:
Dept. of Comput. Sci. & Eng., Minnesota Univ., Minneapolis, MN, USA;-
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2004

Citing 0
Cited 88

Dimension Reduction in Text Classification with Support Vector Machines

The Journal of Machine Learning Research
OCFS: optimal orthogonal centroid feature selection for text categorization

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Effective and Efficient Dimensionality Reduction for Large-Scale and Streaming Data Preprocessing

IEEE Transactions on Knowledge and Data Engineering
Capitalize on Dimensionality Increasing Techniques for Improving Face Recognition Grand Challenge Performance

IEEE Transactions on Pattern Analysis and Machine Intelligence
Discriminant feature extraction using dual-objective optimization model

Pattern Recognition Letters
Orthogonal nonnegative matrix t-factorizations for clustering

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Feature Reduction via Generalized Uncorrelated Linear Discriminant Analysis

IEEE Transactions on Knowledge and Data Engineering
The theoretical analysis of GLRAM and its applications

Pattern Recognition
Solving the small sample size problem in face recognition using generalized discriminant analysis

Pattern Recognition
Adaptive dimension reduction using discriminant analysis and K-means clustering

Proceedings of the 24th international conference on Machine learning
Multiclass classifiers based on dimension reduction with generalized LDA

Pattern Recognition
Uncorrelated linear discriminant analysis based on weighted pairwise Fisher criterion

Pattern Recognition
Hierarchical document classification using automatically generated hierarchy

Journal of Intelligent Information Systems
An integrated system for building enterprise taxonomies

Information Retrieval
A comparison of generalized linear discriminant analysis algorithms

Pattern Recognition
Discriminant Subspace Analysis: A Fukunaga-Koontz Approach

IEEE Transactions on Pattern Analysis and Machine Intelligence
Data-Dependent Kernel Machines for Microarray Data Classification

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
SRDA: An Efficient Algorithm for Large-Scale Discriminant Analysis

IEEE Transactions on Knowledge and Data Engineering
On applying linear discriminant analysis for multi-labeled problems

Pattern Recognition Letters
A fingerprint verification algorithm using tessellated invariant moment features

Neurocomputing
Solution for supervised graph embedding: A case study

Signal Processing
Quality assessment of gene selection in microarray data

Optimization Methods & Software - Systems Analysis, Optimization and Data Mining in Biomedicine
Text categorization via generalized discriminant analysis

Information Processing and Management: an International Journal
On Applying Dimension Reduction for Multi-labeled Problems

MLDM '07 Proceedings of the 5th international conference on Machine Learning and Data Mining in Pattern Recognition
General Solution for Supervised Graph Embedding

ECML '07 Proceedings of the 18th European conference on Machine Learning
A note on two-dimensional linear discriminant analysis

Pattern Recognition Letters
PSOLDA: A particle swarm optimization approach for enhancing classification accuracy rate of linear discriminant analysis

Applied Soft Computing
Tensor linear Laplacian discrimination (TLLD) for feature extraction

Pattern Recognition
Induction of multiclass multifeature split decision trees from distributed data

Pattern Recognition
A Flexible and Efficient Algorithm for Regularized Fisher Discriminant Analysis

ECML PKDD '09 Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part II
Learning a locality discriminating projection for classification

Knowledge-Based Systems
Laplacian Discriminant Projection Based on Affinity Propagation

AICI '09 Proceedings of the International Conference on Artificial Intelligence and Computational Intelligence
A regularization framework for robust dimensionality reduction with applications to image reconstruction and feature extraction

Pattern Recognition
A new and fast implementation for null space based linear discriminant analysis

Pattern Recognition
Generalized discriminant analysis: a matrix exponential approach

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Cross-platform microarray data integration using the Normalised Linear Transform

International Journal of Data Mining and Bioinformatics
Letters: Robust kernel discriminant analysis and its application to feature extraction and recognition

Neurocomputing
Fingerprint classification using fast Fourier transform and nonlinear discriminant analysis

Pattern Recognition
Rapid and brief communication: Generalizing relevance weighted LDA

Pattern Recognition
Data transformations and representations for computation and visualization

Information Visualization
An efficient method for computing orthogonal discriminant vectors

Neurocomputing
Discriminant analysis approach using fuzzy fourfold subspaces model

Neurocomputing
Efficient GSVD based multi-user MIMO linear precoding and antenna selection scheme

ICC'09 Proceedings of the 2009 IEEE international conference on Communications
Lattice reduction aided multi-user MIMO successive interference cancellation combined with linear pre-equalization

ICC'09 Proceedings of the 2009 IEEE international conference on Communications
A rank-one update algorithm for fast solving kernel Foley-Sammon optimal discriminant vectors

IEEE Transactions on Neural Networks
Regularized Discriminant Analysis, Ridge Regression and Beyond

The Journal of Machine Learning Research
Exemplar based Laplacian Discriminant Projection

Expert Systems with Applications: An International Journal
Incremental embedding and learning in the local discriminant subspace with application to face recognition

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Unified formulation of linear discriminant analysis methods and optimal parameter selection

Pattern Recognition
Augmented DT-CWT feature based classification using Regularized Neighborhood Projection Discriminant Analysis for face recognition

Pattern Recognition
Robust kernel discriminant analysis using fuzzy memberships

Pattern Recognition
Generalized nonlinear discriminant analysis and its small sample size problems

Neurocomputing
Uncorrelated trace ratio linear discriminant analysis for undersampled problems

Pattern Recognition Letters
Fast Algorithms for the Generalized Foley-Sammon Discriminant Analysis

SIAM Journal on Matrix Analysis and Applications
A New and Fast Orthogonal Linear Discriminant Analysis on Undersampled Problems

SIAM Journal on Scientific Computing
From centralized to distributed decision tree induction using CHAID and fisher's linear discriminant function algorithms

Intelligent Decision Technologies
Orthogonal Complete Discriminant Locality Preserving Projections for Face Recognition

Neural Processing Letters
Blockwise projection matrix versus blockwise data on undersampled problems: Analysis, comparison and applications

Pattern Recognition
An effective feature selection method for text categorization

PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part I
Supervised Discriminant Projection with Its Application to Face Recognition

Neural Processing Letters
Fast Kernel Discriminant Analysis for Classification of Liver Cancer Mass Spectra

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Improved incremental orthogonal centroid algorithm for visualising pipeline sensor datasets

IVIC'11 Proceedings of the Second international conference on Visual informatics: sustaining research and innovations - Volume Part I
Simultaneous model-based clustering and visualization in the Fisher discriminative subspace

Statistics and Computing
A novel neural-network approach of analog fault diagnosis based on kernel discriminant analysis and particle swarm optimization

Applied Soft Computing
Kernel uncorrelated discriminant analysis for radar target recognition

ICONIP'06 Proceedings of the 13th international conference on Neural Information Processing - Volume Part II
A fast fixed-point algorithm for two-class discriminative feature extraction

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part II
Gabor feature based classification using LDA/QZ algorithm for face recognition

ICNC'06 Proceedings of the Second international conference on Advances in Natural Computation - Volume Part I
Robust discriminant analysis of latent semantic feature for text categorization

FSKD'06 Proceedings of the Third international conference on Fuzzy Systems and Knowledge Discovery
Kernel biased discriminant analysis using histogram intersection kernel for content-based image retrieval

IDEAL'05 Proceedings of the 6th international conference on Intelligent Data Engineering and Automated Learning
A new discriminant subspace analysis approach for multi-class problems

Pattern Recognition
A novel supervised dimensionality reduction algorithm: Graph-based Fisher analysis

Pattern Recognition
Efficient linear discriminant analysis with locality preserving for face recognition

Pattern Recognition
Analysis of Correlation Based Dimension Reduction Methods

International Journal of Applied Mathematics and Computer Science - Issues in Advanced Control and Diagnosis
A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices

Pattern Recognition
Recent advances in subspace analysis for face recognition

SINOBIOMETRICS'04 Proceedings of the 5th Chinese conference on Advances in Biometric Person Authentication
Regularized orthogonal linear discriminant analysis

Pattern Recognition
Exemplar based laplacian discriminant projection

ICSI'10 Proceedings of the First international conference on Advances in Swarm Intelligence - Volume Part II
Feature extraction using fuzzy maximum margin criterion

Neurocomputing
Probabilistic Fisher discriminant analysis: A robust and flexible alternative to Fisher discriminant analysis

Neurocomputing
Enhanced fisher discriminant criterion for image recognition

Pattern Recognition
Hierarchical classification of web documents by stratified discriminant analysis

IRFC'12 Proceedings of the 5th conference on Multidisciplinary Information Retrieval
Application of kernel-genetic algorithm as nonlinear feature selection in tropical wood species recognition system

Computers and Electronics in Agriculture
Exploiting fisher and fukunaga-koontz transforms in chernoff dimensionality reduction

ACM Transactions on Knowledge Discovery from Data (TKDD)
Complexity-reduced implementations of complete and null-space-based linear discriminant analysis

Neural Networks
Bayesian predictive kernel discriminant analysis

Pattern Recognition Letters
Global plus local: A complete framework for feature extraction and recognition

Pattern Recognition
A Rayleigh-Ritz style method for large-scale discriminant analysis

Pattern Recognition
Histogram of visual words based on locally adaptive regression kernels descriptors for image feature extraction

Neurocomputing

Quantified Score

Hi-index	0.15

Visualization

Abstract

Discriminant analysis has been used for decades to extract features that preserve class separability. It is commonly defined as an optimization problem involving covariance matrices that represent the scatter within and between clusters. The requirement that one of these matrices be nonsingular limits its application to data sets with certain relative dimensions. We examine a number of optimization criteria, and extend their applicability by using the generalized singular value decomposition to circumvent the nonsingularity requirement. The result is a generalization of discriminant analysis that can be applied even when the sample size is smaller than the dimension of the sample data. We use classification results from the reduced representation to compare the effectiveness of this approach with some alternatives, and conclude with a discussion of their relative merits.