Trace ratio problem revisited

Authors:
Yangqing Jia;Feiping Nie;Changshui Zhang
Affiliations:
State Key Laboratory on Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology, Department of Automation, Tsinghua University, Beijing, China;State Key Laboratory on Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology, Department of Automation, Tsinghua University, Beijing, China;State Key Laboratory on Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology, Department of Automation, Tsinghua University, Beijing, China
Venue:
IEEE Transactions on Neural Networks
Year:
2009

Citing 5
Cited 12

Matrix analysis

Matrix analysis
A generalized Foley-Sammon transform based on generalized fisher discriminant criterion and its application to face recognition

Pattern Recognition Letters
Graph Embedding and Extensions: A General Framework for Dimensionality Reduction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Face recognition using LDA-based algorithms

IEEE Transactions on Neural Networks
Efficient and robust feature extraction by maximum margin criterion

IEEE Transactions on Neural Networks

Locality preserving discriminant projections for face and palmprint recognition

Neurocomputing
Learning low-rank kernel matrices for constrained clustering

Neurocomputing
Maximum Margin Multisurface Support Tensor Machines with application to image classification and segmentation

Expert Systems with Applications: An International Journal
Graph optimization for dimensionality reduction with sparsity constraints

Pattern Recognition
Robust linearly optimized discriminant analysis

Neurocomputing
Trace ratio criterion based generalized discriminative learning for semi-supervised dimensionality reduction

Pattern Recognition
Incremental complete LDA for face recognition

Pattern Recognition
Constrained large Margin Local Projection algorithms and extensions for multimodal dimensionality reduction

Pattern Recognition
Marginal semi-supervised sub-manifold projections with informative constraints for dimensionality reduction and recognition

Neural Networks
Efficient semi-supervised feature selection with noise insensitive trace ratio criterion

Neurocomputing
Large-scale Structure-from-Motion Reconstruction with small memory consumption

Proceedings of International Conference on Advances in Mobile Computing & Multimedia
A Rayleigh-Ritz style method for large-scale discriminant analysis

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

Dimensionality reduction is an important issue in many machine learning and pattern recognition applications, and the trace ratio (TR) problem is an optimization problem involved in many dimensionality reduction algorithms. Conventionally, the solution is approximated via generalized eigenvalue decomposition due to the difficulty of the original problem. However, prior works have indicated that it is more reasonable to solve it directly than via the conventional way. In this brief, we propose a theoretical overview of the global optimum solution to the TR problem via the equivalent trace difference problem. Eigenvalue perturbation theory is introduced to derive an efficient algorithm based on the Newton-Raphson method. Theoretical issues on the convergence and efficiency of our algorithm compared with prior literature are proposed, and are further supported by extensive empirical results.