Stochastic neighbor projection on manifold for feature extraction

Authors:
Songsong Wu;Mingming Sun;Jingyu Yang
Affiliations:
School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing 210094, China;School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing 210094, China;School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing 210094, China
Venue:
Neurocomputing
Year:
2011

Citing 19
Cited 0

Independent component analysis, a new concept?

Signal Processing - Special issue on higher order statistics
Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Nonlinear component analysis as a kernel eigenvalue problem

Neural Computation
Laplacian Eigenmaps for dimensionality reduction and data representation

Neural Computation
Kernel independent component analysis

The Journal of Machine Learning Research
KPCA Plus LDA: A Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment

SIAM Journal on Scientific Computing
Face Recognition Using Laplacianfaces

IEEE Transactions on Pattern Analysis and Machine Intelligence
Neighborhood Preserving Embedding

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Graph Embedding and Extensions: A General Framework for Dimensionality Reduction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Letters: Linear local tangent space alignment and application to face recognition

Neurocomputing
Eigenfaces for recognition

Journal of Cognitive Neuroscience
Discriminative Locality Alignment

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Geometric Mean for Subspace Selection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Transductive Component Analysis

ICDM '08 Proceedings of the 2008 Eighth IEEE International Conference on Data Mining
Patch Alignment for Dimensionality Reduction

IEEE Transactions on Knowledge and Data Engineering
Unsupervised learning of image manifolds by semidefinite programming

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Max-Min Distance Analysis by Using Sequential SDP Relaxation for Dimension Reduction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Manifold elastic net: a unified framework for sparse dimension reduction

Data Mining and Knowledge Discovery

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper develops a manifold-oriented stochastic neighbor projection (MSNP) technique for feature extraction. MSNP is designed to find a linear projection for the purpose of capturing the underlying pattern structure of observations that actually lie on a nonlinear manifold. In MSNP, the similarity information of observations is encoded with stochastic neighbor distribution based on geodesic distance metric, then the same distribution is required to be hold in feature space. This learning criterion not only empowers MSNP to extract nonlinear feature through a linear projection, but makes MSNP competitive as well by reason that distribution preservation is more workable and flexible than rigid distance preservation. MSNP is evaluated in three applications: data visualization for faces image, face recognition and palmprint recognition. Experimental results on several benchmark databases suggest that the proposed MSNP provides a unsupervised feature extraction approach with powerful pattern revealing capability for complex manifold data.