KPCA Plus LDA: A Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition

Authors:
Jian Yang;Alejandro F. Frangi;Jing-yu Yang;David Zhang;Zhong Jin
Affiliations:
-;-;-;IEEE;-
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2005

Citing 21
Cited 170

Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces

IEEE Transactions on Pattern Analysis and Machine Intelligence
Introduction to statistical pattern recognition (2nd ed.)

Introduction to statistical pattern recognition (2nd ed.)
The nature of statistical learning theory

The nature of statistical learning theory
Using Discriminant Eigenfeatures for Image Retrieval

IEEE Transactions on Pattern Analysis and Machine Intelligence
Matrix computations (3rd ed.)

Matrix computations (3rd ed.)
Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Nonlinear component analysis as a kernel eigenvalue problem

Neural Computation
The FERET Evaluation Methodology for Face-Recognition Algorithms

IEEE Transactions on Pattern Analysis and Machine Intelligence
Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm

Neural Networks
Bayesian framework for least-squares support vector machine classifiers, Gaussian processes, and kernel fisher discriminant analysis

Neural Computation
Estimating a Kernel Fisher Discriminant in the Presence of Label Noise

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Constructing Descriptive and Discriminative Nonlinear Features: Rayleigh Coefficients in Kernel Feature Spaces

IEEE Transactions on Pattern Analysis and Machine Intelligence
Discriminant Analysis of Principal Components for Face Recognition

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Recognition of Handwritten Numerals Using Gabor Features

ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Kernel Eigenfaces vs. Kernel Fisherfaces: Face Recognition Using Kernel Methods

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Recognizing faces with PCA and ICA

Computer Vision and Image Understanding - Special issue on Face recognition
Generalized Discriminant Analysis Using a Kernel Approach

Neural Computation
Robust coding schemes for indexing and retrieval from large face databases

IEEE Transactions on Image Processing
A shape- and texture-based enhanced Fisher classifier for face recognition

IEEE Transactions on Image Processing
An introduction to kernel-based learning algorithms

IEEE Transactions on Neural Networks
Face recognition using kernel direct discriminant analysis algorithms

IEEE Transactions on Neural Networks

Discriminant Analysis: A Unified Approach

ICDM '05 Proceedings of the Fifth IEEE International Conference on Data Mining
Capitalize on Dimensionality Increasing Techniques for Improving Face Recognition Grand Challenge Performance

IEEE Transactions on Pattern Analysis and Machine Intelligence
Optimal kernel selection in Kernel Fisher discriminant analysis

ICML '06 Proceedings of the 23rd international conference on Machine learning
Null space versus orthogonal linear discriminant analysis

ICML '06 Proceedings of the 23rd international conference on Machine learning
Subclass Discriminant Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Class-dependent PCA, MDC and LDA: A combined classifier for pattern classification

Pattern Recognition
Rapid and brief communication: Laplacian linear discriminant analysis

Pattern Recognition
Face recognition using a kernel fractional-step discriminant analysis algorithm

Pattern Recognition
2D-LPP: A two-dimensional extension of locality preserving projections

Neurocomputing
Combination of two novel LDA-based methods for face recognition

Neurocomputing
Improved discriminate analysis for high-dimensional data and its application to face recognition

Pattern Recognition
Identification of contributing variables using kernel-based discriminant modeling and reconstruction

Expert Systems with Applications: An International Journal
The discriminant elastic graph matching algorithm applied to frontal face verification

Pattern Recognition
Computational and Theoretical Analysis of Null Space and Orthogonal Linear Discriminant Analysis

The Journal of Machine Learning Research
Local Discriminant Wavelet Packet Coordinates for Face Recognition

The Journal of Machine Learning Research
Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Applications to Face and Palm Biometrics

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast communication: Gabor feature-based face recognition using supervised locality preserving projection

Signal Processing
Letters: A reformative kernel Fisher discriminant algorithm and its application to face recognition

Neurocomputing
Letters: An alternative formulation of kernel LPP with application to image recognition

Neurocomputing
Uncorrelated linear discriminant analysis based on weighted pairwise Fisher criterion

Pattern Recognition
Localized versus locality-preserving subspace projections for face recognition

Journal on Image and Video Processing
Letters: Kernel subclass discriminant analysis

Neurocomputing
A two stage algorithm for face recognition: 2DPCA and within-class scatter minimization

SPPR'07 Proceedings of the Fourth conference on IASTED International Conference: Signal Processing, Pattern Recognition, and Applications
Kernel class-wise locality preserving projection

Information Sciences: an International Journal
A Direct Locality Preserving Projections (DLPP) Algorithm for Image Recognition

Neural Processing Letters
A unified framework for semi-supervised dimensionality reduction

Pattern Recognition
Linear dimensionality reduction by maximizing the Chernoff distance in the transformed space

Pattern Recognition
Dimensionality reduction based on ICA for regression problems

Neurocomputing
Adaptive quasiconformal kernel discriminant analysis

Neurocomputing
Interest filter vs. interest operator: Face recognition using Fisher linear discriminant based on interest filter representation

Pattern Recognition Letters
1D correlation filter based class-dependence feature analysis for face recognition

Pattern Recognition
Letters: Null space discriminant locality preserving projections for face recognition

Neurocomputing
Feature extraction for one-class classification problems: Enhancements to biased discriminant analysis

Pattern Recognition
Subspace KDA Algorithm for Non-linear Feature Extraction in Face Identification

Computational Intelligence and Security
Face Recognition from a Single Image per Person Using Common Subfaces Method

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Part II--Advances in Neural Networks
A Criterion for Learning the Data-Dependent Kernel for Classification

ADMA '07 Proceedings of the 3rd international conference on Advanced Data Mining and Applications
Systematic benchmarking of microarray data feature extraction and classification

International Journal of Computer Mathematics
Complete discriminant evaluation and feature extraction in kernel space for face recognition

Machine Vision and Applications
Optimal Local Basis: A Reinforcement Learning Approach for Face Recognition

International Journal of Computer Vision
Weighted locally linear embedding for dimension reduction

Pattern Recognition
An efficient discriminant-based solution for small sample size problem

Pattern Recognition
Tensor linear Laplacian discrimination (TLLD) for feature extraction

Pattern Recognition
Bagging null space locality preserving discriminant classifiers for face recognition

Pattern Recognition
Face recognition across pose: A review

Pattern Recognition
A Classification Framework for Large-Scale Face Recognition Systems

ICB '09 Proceedings of the Third International Conference on Advances in Biometrics
A decision-boundary-oriented feature selection method and its application to face recognition

Pattern Recognition Letters
A direct evolutionary feature extraction algorithm for classifying high dimensional data

AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
A novel kernel-based maximum a posteriori classification method

Neural Networks
Fuzzy linear and nonlinear discriminant analysis algorithms for face recognition

Intelligent Data Analysis
Face Recognition Using ALLE and SIFT for Human Robot Interaction

Proceedings of the FIRA RoboWorld Congress 2009 on Advances in Robotics
Curvelet based face recognition via dimension reduction

Signal Processing
Neighbourhood preserving discriminant embedding in face recognition

Journal of Visual Communication and Image Representation
A complete fuzzy discriminant analysis approach for face recognition

Applied Soft Computing
Face recognition under occlusions and variant expressions with partial similarity

IEEE Transactions on Information Forensics and Security
Fast algorithm for updating the discriminant vectors of dual-space LDA

IEEE Transactions on Information Forensics and Security
Novel multiclass classifiers based on the minimization of the within-class variance

IEEE Transactions on Neural Networks
Discriminant nonnegative tensor factorization algorithms

IEEE Transactions on Neural Networks
Feature extraction by multilayer perceptron: visualization of internal representation of input data

VIIP '07 The Seventh IASTED International Conference on Visualization, Imaging and Image Processing
An MRF-based kernel method for nonlinear feature extraction

Image and Vision Computing
Image replica detection system utilizing R-trees and linear discriminant analysis

Pattern Recognition
Evolutionary discriminant feature extraction with application to face recognition

EURASIP Journal on Advances in Signal Processing - Special issue on recent advances in biometric systems: a signal processing perspective
Laplacian Discriminant Projection Based on Affinity Propagation

AICI '09 Proceedings of the International Conference on Artificial Intelligence and Computational Intelligence
A two stage algorithm for face recognition: 2DPCA and within-class scatter minimization

SPPRA '07 Proceedings of the Fourth IASTED International Conference on Signal Processing, Pattern Recognition, and Applications
A general kernelization framework for learning algorithms based on kernel PCA

Neurocomputing
Local contrast enhancement and adaptive feature extraction for illumination-invariant face recognition

Pattern Recognition
A pre-clustering technique for optimizing subclass discriminant analysis

Pattern Recognition Letters
Multi-class pairwise linear dimensionality reduction using heteroscedastic schemes

Pattern Recognition
Prediction of eigenvalues and regularization of eigenfeatures for human face verification

Pattern Recognition Letters
DLDA/QR: a robust direct LDA algorithm for face recognition and its theoretical foundation

PAKDD'07 Proceedings of the 11th Pacific-Asia conference on Advances in knowledge discovery and data mining
A variational framework for adaptive satellite images segmentation

SSVM'07 Proceedings of the 1st international conference on Scale space and variational methods in computer vision
On minimum class locality preserving variance support vector machine

Pattern Recognition
Kernel-based nonlinear discriminant analysis using minimum squared errors criterion for multiclass and undersampled problems

Signal Processing
Post-processed LDA for face and palmprint recognition: What is the rationale

Signal Processing
A modification of kernel discriminant analysis for high-dimensional data-with application to face recognition

Signal Processing
Integrating global and local structures in semi-supervised discriminant analysis

IITA'09 Proceedings of the 3rd international conference on Intelligent information technology application
Feature extraction based on subspace methods for regression problems

Neurocomputing
Discriminant analysis approach using fuzzy fourfold subspaces model

Neurocomputing
Quotient vs. difference: Comparison between the two discriminant criteria

Neurocomputing
Geodesic discriminant analysis on curved riemannian manifold

FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 5
Fusion of movement specific human identification experts

BioID_MultiComm'09 Proceedings of the 2009 joint COST 2101 and 2102 international conference on Biometric ID management and multimodal communication
Human identification from human movements

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Misalignment-robust face recognition

IEEE Transactions on Image Processing
A rank-one update algorithm for fast solving kernel Foley-Sammon optimal discriminant vectors

IEEE Transactions on Neural Networks
Novel maximum-margin training algorithms for supervised neural networks

IEEE Transactions on Neural Networks
Symbolic kernel fisher discriminant method with a new RBF kernel function for face recognition

Machine Graphics & Vision International Journal
Enhanced local texture feature sets for face recognition under difficult lighting conditions

IEEE Transactions on Image Processing
Dimension reduction by a novel unified scheme using divergence analysis and genetic search

Digital Signal Processing
Detecting influential observations in Kernel PCA

Computational Statistics & Data Analysis
Exemplar based Laplacian Discriminant Projection

Expert Systems with Applications: An International Journal
Orientation distance-based discriminative feature extraction for multi-class classification

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Unified formulation of linear discriminant analysis methods and optimal parameter selection

Pattern Recognition
Robust kernel discriminant analysis using fuzzy memberships

Pattern Recognition
Visual object tracking via sparse reconstruction

ICIMCS '10 Proceedings of the Second International Conference on Internet Multimedia Computing and Service
From classifiers to discriminators: A nearest neighbor rule induced discriminant analysis

Pattern Recognition
Kernel discriminant transformation for image set-based face recognition

Pattern Recognition
A novel biometric feature extraction algorithm using two dimensional fisherface in 2DPCA subspace for face recognition

SSIP'05 Proceedings of the 5th WSEAS international conference on Signal, speech and image processing
Visual object tracking via sample-based Adaptive Sparse Representation (AdaSR)

Pattern Recognition
Modified locally linear discriminant embedding for plant leaf recognition

Neurocomputing
Face recognition based on the multi-scale local image structures

Pattern Recognition
Supervised Discriminant Projection with Its Application to Face Recognition

Neural Processing Letters
Face Recognition Using Kernel UDP

Neural Processing Letters
Matrix pattern based minimum within-class scatter support vector machines

Applied Soft Computing
Extract minimum positive and maximum negative features for imbalanced binary classification

Pattern Recognition
Weighted generalized kernel discriminant analysis using fuzzy memberships

WSEAS Transactions on Mathematics
Kernel-based weighted discriminant analysis with QR decomposition and its application to face recognition

WSEAS Transactions on Mathematics
A novel neural-network approach of analog fault diagnosis based on kernel discriminant analysis and particle swarm optimization

Applied Soft Computing
On optimizing kernel-based fisher discriminant analysis using prototype reduction schemes

SSPR'06/SPR'06 Proceedings of the 2006 joint IAPR international conference on Structural, Syntactic, and Statistical Pattern Recognition
Gabor feature based classification using LDA/QZ algorithm for face recognition

ICNC'06 Proceedings of the Second international conference on Advances in Natural Computation - Volume Part I
Gabor feature based face recognition using supervised locality preserving projection

ACIVS'06 Proceedings of the 8th international conference on Advanced Concepts For Intelligent Vision Systems
Inter-modality face recognition

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Extending kernel fisher discriminant analysis with the weighted pairwise chernoff criterion

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
A testing methodology for face recognition algorithms

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction
Regularization of LDA for face recognition: a post-processing approach

AMFG'05 Proceedings of the Second international conference on Analysis and Modelling of Faces and Gestures
Face recognition by inverse fisher discriminant features

ICB'06 Proceedings of the 2006 international conference on Advances in Biometrics
Robust linearly optimized discriminant analysis

Neurocomputing
A novel supervised dimensionality reduction algorithm: Graph-based Fisher analysis

Pattern Recognition
Trace ratio criterion based generalized discriminative learning for semi-supervised dimensionality reduction

Pattern Recognition
Discover latent discriminant information for dimensionality reduction: Non-negative Sparseness Preserving Embedding

Pattern Recognition
Dimensionality reduction based on nonparametric discriminant analysis with kernels for feature extraction and recognition

Proceedings of the 4th International Conference on Uniquitous Information Management and Communication
Kernel discriminant analysis for regression problems

Pattern Recognition
Multi-view human movement recognition based on fuzzy distances and linear discriminant analysis

Computer Vision and Image Understanding
A novel LDA approach for high-dimensional data

ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part I
A survey on feature extraction for pattern recognition

Artificial Intelligence Review
Incremental complete LDA for face recognition

Pattern Recognition
Kernel modified quadratic discriminant function for facial expression recognition

IWICPAS'06 Proceedings of the 2006 Advances in Machine Vision, Image Processing, and Pattern Analysis international conference on Intelligent Computing in Pattern Analysis/Synthesis
Kernel fisher LPP for face recognition

MRCS'06 Proceedings of the 2006 international conference on Multimedia Content Representation, Classification and Security
Exemplar based laplacian discriminant projection

ICSI'10 Proceedings of the First international conference on Advances in Swarm Intelligence - Volume Part II
Feature Extraction Using a Complete Kernel Extension of Supervised Graph Embedding

Neural Processing Letters
Incremental learning of complete linear discriminant analysis for face recognition

Knowledge-Based Systems
Complete local Fisher discriminant analysis with Laplacian score ranking for face recognition

Neurocomputing
Optimal subset-division based discrimination and its kernelization for face and palmprint recognition

Pattern Recognition
Directional discriminant analysis based on nearest feature line

ACIIDS'12 Proceedings of the 4th Asian conference on Intelligent Information and Database Systems - Volume Part II
Regularized locality preserving discriminant analysis for face recognition

Neurocomputing
Kernel machine-based rank-lifting regularized discriminant analysis method for face recognition

Neurocomputing
Stochastic neighbor projection on manifold for feature extraction

Neurocomputing
Modified orthogonal discriminant projection for classification

Neurocomputing
Fast kernel Fisher discriminant analysis via approximating the kernel principal component analysis

Neurocomputing
Fisher Difference Discriminant Analysis: Determining the Effective Discriminant Subspace Dimensions for Face Recognition

Neural Processing Letters
Constrained large Margin Local Projection algorithms and extensions for multimodal dimensionality reduction

Pattern Recognition
Orthogonal discriminant vector for face recognition across pose

Pattern Recognition
Gabor feature-based fast neighborhood component analysis for face recognition

ICIC'12 Proceedings of the 8th international conference on Intelligent Computing Theories and Applications
The Study of Content Security for Mobile Internet

Wireless Personal Communications: An International Journal
Quasiconformal kernel common locality discriminant analysis with application to breast cancer diagnosis

Information Sciences: an International Journal
Subspace regularized linear discriminant analysis for small sample size problems

PRICAI'12 Proceedings of the 12th Pacific Rim international conference on Trends in Artificial Intelligence
Subspace learning in krein spaces: complete kernel fisher discriminant analysis with indefinite kernels

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Stability of dimensionality reduction methods applied on artificial hyperspectral images

ICCVG'12 Proceedings of the 2012 international conference on Computer Vision and Graphics
Complete large margin linear discriminant analysis using mathematical programming approach

Pattern Recognition
Local Linear Regression on Hybrid Eigenfaces for Pose Invariant Face Recognition

International Journal of Computer Vision and Image Processing
Super-class Discriminant Analysis: A novel solution for heteroscedasticity

Pattern Recognition Letters
A novel unconstrained correlation filter and its application in face recognition

IScIDE'12 Proceedings of the third Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Letters: Orthogonal kernel projecting plane for radar HRRP recognition

Neurocomputing
Generalization of linear discriminant analysis using Lp-norm

Pattern Recognition Letters
Graph-preserving shortest feature line segment for dimensionality reduction

Neurocomputing
Evaluation of weighted Fisher criteria for large category dimensionality reduction in application to Chinese handwriting recognition

Pattern Recognition
Face recognition using Gabor-based direct linear discriminant analysis and support vector machine

Computers and Electrical Engineering
Using robust dispersion estimation in support vector machines

Pattern Recognition
An effective unconstrained correlation filter and its kernelization for face recognition

Neurocomputing
Letters: Fuzzy MSD based feature extraction method for face recognition

Neurocomputing
A fuzzy supervised learning method with dynamical parameter estimation for nonlinear discriminant analysis

Computers & Mathematics with Applications
Regularized discriminant entropy analysis

Pattern Recognition
Discriminative Orthogonal Nonnegative matrix factorization with flexibility for data representation

Expert Systems with Applications: An International Journal
Fractional-order embedding canonical correlation analysis and its applications to multi-view dimensionality reduction and recognition

Pattern Recognition
Global plus local: A complete framework for feature extraction and recognition

Pattern Recognition
A Rayleigh-Ritz style method for large-scale discriminant analysis

Pattern Recognition
Histogram of visual words based on locally adaptive regression kernels descriptors for image feature extraction

Neurocomputing
Robust recognition of face with partial variations using local features and statistical learning

Neurocomputing
Rough set based pose invariant face recognition with mug shot images

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
Uniform Local Derivative Patterns and Their Application in Face Recognition

Journal of Signal Processing Systems
Soft label based Linear Discriminant Analysis for image recognition and retrieval

Computer Vision and Image Understanding
Kernel inverse Fisher discriminant analysis for face recognition

Neurocomputing

Quantified Score

Hi-index	0.15

Visualization

Abstract

This paper examines the theory of kernel Fisher discriminant analysis (KFD) in a Hilbert space and develops a two-phase KFD framework, i.e., kernel principal component analysis (KPCA) plus Fisher linear discriminant analysis (LDA). This framework provides novel insights into the nature of KFD. Based on this framework, the authors propose a complete kernel Fisher discriminant analysis (CKFD) algorithm. CKFD can be used to carry out discriminant analysis in "double discriminant subspaces.驴 The fact that, it can make full use of two kinds of discriminant information, regular and irregular, makes CKFD a more powerful discriminator. The proposed algorithm was tested and evaluated using the FERET face database and the CENPARMI handwritten numeral database. The experimental results show that CKFD outperforms other KFD algorithms.