Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Authors:
Ran He; Bao-Gang Hu; Wei-Shi Zheng; Xiang-Wei Kong
Affiliations:
Nat. Lab. of Pattern Recognition, Chinese Acad. of Sci., Beijing, China;-;-;-
Venue:
IEEE Transactions on Image Processing
Year:
2011

Citing 0
Cited 7

Discriminant sparse neighborhood preserving embedding for face recognition

Pattern Recognition
Recursive robust least squares support vector regression based on maximum correntropy criterion

Neurocomputing
Correntropy-Based document clustering via nonnegative matrix factorization

ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II
Euler Principal Component Analysis

International Journal of Computer Vision
Robust spectral regression for face recognition

Neurocomputing
Locally discriminative spectral clustering with composite manifold

Neurocomputing
Regularized correntropy criterion based feature extraction for novelty detection

Neurocomputing

Quantified Score

Hi-index	0.01

Visualization

Abstract

Principal component analysis (PCA) minimizes the mean square error (MSE) and is sensitive to outliers. In this paper, we present a new rotational-invariant PCA based on maximum correntropy criterion (MCC). A half-quadratic optimization algorithm is adopted to compute the correntropy objective. At each iteration, the complex optimization problem is reduced to a quadratic problem that can be efficiently solved by a standard optimization method. The proposed method exhibits the following benefits: 1) it is robust to outliers through the mechanism of MCC which can be more theoretically solid than a heuristic rule based on MSE; 2) it requires no assumption about the zero-mean of data for processing and can estimate data mean during optimization; and 3) its optimal solution consists of principal eigenvectors of a robust covariance matrix corresponding to the largest eigenvalues. In addition, kernel techniques are further introduced in the proposed method to deal with nonlinearly distributed data. Numerical results demonstrate that the proposed method can outperform robust rotational-invariant PCAs based on L1 norm when outliers occur.