Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment

Authors:
Zhenyue Zhang;Hongyuan Zha
Affiliations:
-;-
Venue:
SIAM Journal on Scientific Computing
Year:
2005

Citing 0
Cited 175

Unsupervised Learning of Image Manifolds by Semidefinite Programming

International Journal of Computer Vision
A duality view of spectral methods for dimensionality reduction

ICML '06 Proceedings of the 23rd international conference on Machine learning
Semi-supervised nonlinear dimensionality reduction

ICML '06 Proceedings of the 23rd international conference on Machine learning
Rapid and Brief communication: Formulating LLE using alignment technique

Pattern Recognition
Letters: Linear local tangent space alignment and application to face recognition

Neurocomputing
Surface parameterization via aligning optimal local flattening

Proceedings of the 2007 ACM symposium on Solid and physical modeling
Robust non-linear dimensionality reduction using successive 1-dimensional Laplacian Eigenmaps

Proceedings of the 24th international conference on Machine learning
Hallucinating faces: LPH super-resolution and neighbor reconstruction for residue compensation

Pattern Recognition
Ranking with semi-supervised distance metric learning and its application to housing potential estimation

Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
A sensorimotor approach to sound localization

Neural Computation
Person-independent head pose estimation using biased manifold embedding

EURASIP Journal on Advances in Signal Processing
Fast communication: Supervised kernel neighborhood preserving projections for radar target recognition

Signal Processing
Noisy manifold learning using neighborhood smoothing embedding

Pattern Recognition Letters
Feature extraction using constrained maximum variance mapping

Pattern Recognition
Semi-supervised sub-manifold discriminant analysis

Pattern Recognition Letters
Improve local tangent space alignment using various dimensional local coordinates

Neurocomputing
Comparison of Dimension Reduction Methods for Database-Adaptive 3D Model Retrieval

Adaptive Multimedial Retrieval: Retrieval, User, and Semantics
Local Coordinates Alignment and Its Linearization

Neural Information Processing
Walking Appearance Manifolds without Falling Off

Neural Information Processing
Distortion-Free Nonlinear Dimensionality Reduction

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Manifold Learning: The Price of Normalization

The Journal of Machine Learning Research
Cross-media manifold learning for image retrieval & annotation

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Discriminative Locality Alignment

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Embedded Map Projection for Dimensionality Reduction-Based Similarity Search

SSPR & SPR '08 Proceedings of the 2008 Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition
LDR-LLE: LLE with Low-Dimensional Neighborhood Representation

ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
Letters: Orthogonal discriminant linear local tangent space alignment for face recognition

Neurocomputing
Incremental Manifold Learning Algorithm Using PCA on Overlapping Local Neighborhoods for Dimensionality Reduction

ISICA '08 Proceedings of the 3rd International Symposium on Advances in Computation and Intelligence
Supervised locally linear embedding with probability-based distance for classification

Computers & Mathematics with Applications
Kernel based nonlinear dimensionality reduction for microarray gene expression data analysis

Expert Systems with Applications: An International Journal
Nonlinear data projection on non-Euclidean manifolds with controlled trade-off between trustworthiness and continuity

Neurocomputing
Nonlinear dimensionality reduction with relative distance comparison

Neurocomputing
Combining local and global information for nonlinear dimensionality reduction

Neurocomputing
Local linear transformation embedding

Neurocomputing
Stable local dimensionality reduction approaches

Pattern Recognition
Finding representative landmarks of data on manifolds

Pattern Recognition
Topology Preservation Measures in the Visualization of Manifold-Type Multidimensional Data

Informatica
Informative Laplacian Projection

SCIA '09 Proceedings of the 16th Scandinavian Conference on Image Analysis
Local procrustes for manifold embedding: a measure of embedding quality and embedding algorithms

Machine Learning
Nonlinear Embedded Map Projection for Dimensionality Reduction

ICIAP '09 Proceedings of the 15th International Conference on Image Analysis and Processing
Learning distance metric for regression by semidefinite programming with application to human age estimation

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Incremental Laplacian eigenmaps by preserving adjacent information between data points

Pattern Recognition Letters
Supervised local tangent space alignment for classification

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Manifold-based learning and synthesis

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Nonlinear dimensionality reduction by locally linear inlaying

IEEE Transactions on Neural Networks
Adaptive Neighborhood Select Based on Local Linearity for Nonlinear Dimensionality Reduction

ISICA '09 Proceedings of the 4th International Symposium on Advances in Computation and Intelligence
Dynamic Neighborhood Selection for Nonlinear Dimensionality Reduction

MDAI '09 Proceedings of the 6th International Conference on Modeling Decisions for Artificial Intelligence
Regularized Kernel Local Linear Embedding on Dimensionality Reduction for Non-vectorial Data

AI '09 Proceedings of the 22nd Australasian Joint Conference on Advances in Artificial Intelligence
Dimensionality reduction by self organizing maps that preserve distances in output space

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Nonlinear embedding preserving multiple local-linearities

Pattern Recognition
Statistical Methods and Models for Video-Based Tracking, Modeling, and Recognition

Foundations and Trends in Signal Processing
Distance approximating dimension reduction of Riemannian manifolds

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Discriminative orthogonal neighborhood-preserving projections for classification

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Adaptive local dissimilarity measures for discriminative dimension reduction of labeled data

Neurocomputing
Distinguishing variance embedding

Image and Vision Computing
Dimensionality Estimation, Manifold Learning and Function Approximation using Tensor Voting

The Journal of Machine Learning Research
Embedding new data points for manifold learning via coordinate propagation

PAKDD'07 Proceedings of the 11th Pacific-Asia conference on Advances in knowledge discovery and data mining
Active reranking for web image search

IEEE Transactions on Image Processing
High throughput analysis of breast cancer specimens on the grid

MICCAI'07 Proceedings of the 10th international conference on Medical image computing and computer-assisted intervention - Volume Part I
Nonlinear dimensionality reduction with hybrid distance for trajectory representation of dynamic texture

Signal Processing
A novel local sensitive frontier analysis for feature extraction

ICIC'09 Proceedings of the Intelligent computing 5th international conference on Emerging intelligent computing technology and applications
A model of selecting the parameters based on the variance of distance ratios for manifold learning algorithms

FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 2
Semi-supervised learning with varifold Laplacians

Neurocomputing
Classification by semi-supervised discriminative regularization

Neurocomputing
Technical Section: Mesh reconstruction by meshless denoising and parameterization

Computers and Graphics
Learning the dynamical system behind sensory data

Neural Computation
Manifold reconstruction using tangential Delaunay complexes

Proceedings of the twenty-sixth annual symposium on Computational geometry
Discriminant feature extraction based on center distance

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Evolutionary cross-domain discriminative hessian eigenmaps

IEEE Transactions on Image Processing
Learning an intrinsic-variable preserving manifold for dynamic visual tracking

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on game theory
Feature extraction by learning Lorentzian metric tensor and its extensions

Pattern Recognition
Marginal discriminant projections: An adaptable margin discriminant approach to feature reduction and extraction

Pattern Recognition Letters
Radar target recognition based on KLLE and a KNRD classifier

WSEAS Transactions on Signal Processing
Linear discriminant projection embedding based on patches alignment

Image and Vision Computing
Similarity preserving principal curve: an optimal 1-D feature extractor for data representation

IEEE Transactions on Neural Networks
Manifold learning for the semi-supervised induction of FrameNet predicates: an empirical investigation

GEMS '10 Proceedings of the 2010 Workshop on GEometrical Models of Natural Language Semantics
Dimensionality reduction techniques for blog visualization

Expert Systems with Applications: An International Journal
Fast ISOMAP based on minimum set coverage

ICIC'10 Proceedings of the Advanced intelligent computing theories and applications, and 6th international conference on Intelligent computing
Orthogonal discriminant local tangent space alignment

ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing
An incremental manifold learning algorithm based on the small world model

LSMS/ICSEE'10 Proceedings of the 2010 international conference on Life system modeling and and intelligent computing, and 2010 international conference on Intelligent computing for sustainable energy and environment: Part I
An automatic patient-specific seizure onset detection method in intracranial EEG based on incremental nonlinear dimensionalityreduction

Computers in Biology and Medicine
An improved local tangent space alignment method for manifold learning

Pattern Recognition Letters
The dynamical neighborhood selection based on the sampling density and manifold curvature for isometric data embedding

Pattern Recognition Letters
Dimensionality reduction by using sparse reconstruction embedding

PCM'10 Proceedings of the Advances in multimedia information processing, and 11th Pacific Rim conference on Multimedia: Part II
Local smoothing for manifold learning

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Enhanced locality preserving projections using robust path based similarity

Neurocomputing
Multiview spectral embedding

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Local margin based semi-supervised discriminant embedding for visual recognition

Neurocomputing
Orthogonal local spline discriminant projection with application to face recognition

Pattern Recognition Letters
Robust Positive semidefinite L-Isomap Ensemble

Pattern Recognition Letters
An SDP-Based Divide-and-Conquer Algorithm for Large-Scale Noisy Anchor-Free Graph Realization

SIAM Journal on Scientific Computing
Manifold elastic net: a unified framework for sparse dimension reduction

Data Mining and Knowledge Discovery
Incremental manifold learning by spectral embedding methods

Pattern Recognition Letters
Nonlinear dimensionality reduction using a temporal coherence principle

Information Sciences: an International Journal
Robust local tangent space alignment via iterative weighted PCA

Neurocomputing
Incremental alignment manifold learning

Journal of Computer Science and Technology - Special issue on natural language processing
Locally affine patch mapping and global refinement for image super-resolution

Pattern Recognition
A detailed investigation into low-level feature detection in spectrogram images

Pattern Recognition
Modified locally linear discriminant embedding for plant leaf recognition

Neurocomputing
Front end analysis of speech recognition: a review

International Journal of Speech Technology
Locally linear embedding: a survey

Artificial Intelligence Review
Locally Minimizing Embedding and Globally Maximizing Variance: Unsupervised Linear Difference Projection for Dimensionality Reduction

Neural Processing Letters
An empirical study on the performance of spectral manifold learning techniques

ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
Manifold learning for visualization of vibrational states of a rotating machine

ICANN'11 Proceedings of the 21st international conference on Artificial neural networks - Volume Part II
High dimensional correspondences from low dimensional manifolds: an empirical comparison of graph-based dimensionality reduction algorithms

ACCV'10 Proceedings of the 2010 international conference on Computer vision - Volume part II
Uncorrelated neighborhood preserving projections for face recognition

AICI'11 Proceedings of the Third international conference on Artificial intelligence and computational intelligence - Volume Part III
A large-scale manifold learning approach for brain tumor progression prediction

MLMI'11 Proceedings of the Second international conference on Machine learning in medical imaging
A visualization metric for dimensionality reduction

Expert Systems with Applications: An International Journal
Gene expression data classification based on improved semi-supervised local Fisher discriminant analysis

Expert Systems with Applications: An International Journal
Letters: Extended local tangent space alignment for classification

Neurocomputing
Spline embedding for nonlinear dimensionality reduction

ECML'06 Proceedings of the 17th European conference on Machine Learning
Riemannian manifold learning for nonlinear dimensionality reduction

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Discover latent discriminant information for dimensionality reduction: Non-negative Sparseness Preserving Embedding

Pattern Recognition
A spectral clustering technique for studying post-transplant kidney functions

Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium
Supervised learning for classification

FSKD'05 Proceedings of the Second international conference on Fuzzy Systems and Knowledge Discovery - Volume Part II
Lorentzian discriminant projection and its applications

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Learning bundle manifold by double neighborhood graphs

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
A local tangent space alignment based transductive classification algorithm

ANNPR'06 Proceedings of the Second international conference on Artificial Neural Networks in Pattern Recognition
Incremental manifold learning via tangent space alignment

ANNPR'06 Proceedings of the Second international conference on Artificial Neural Networks in Pattern Recognition
Gene Classification Using Parameter-Free Semi-Supervised Manifold Learning

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Face recognition using discriminant sparsity neighborhood preserving embedding

Knowledge-Based Systems
Dimensionality reduction via compressive sensing

Pattern Recognition Letters
Image classification by multimodal subspace learning

Pattern Recognition Letters
Local CCA alignment and its applications

Neurocomputing
Complete local Fisher discriminant analysis with Laplacian score ranking for face recognition

Neurocomputing
Sparse transfer learning for interactive video search reranking

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Angular decomposition

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Local and structural consistency for multi-manifold clustering

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
A novel maximum margin neighborhood preserving embedding for face recognition

Future Generation Computer Systems
Enhanced semi-supervised local Fisher discriminant analysis for face recognition

Future Generation Computer Systems
Ear recognition based on uncorrelated local Fisher discriminant analysis

Neurocomputing
Stochastic neighbor projection on manifold for feature extraction

Neurocomputing
Fisher Difference Discriminant Analysis: Determining the Effective Discriminant Subspace Dimensions for Face Recognition

Neural Processing Letters
A new embedding quality assessment method for manifold learning

Neurocomputing
Sequential manifold learning for efficient churn prediction

Expert Systems with Applications: An International Journal
Orthogonal projection analysis

IScIDE'11 Proceedings of the Second Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Modeling and monitoring of multimodes process

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
Data-based modeling and monitoring for multimode processes using local tangent space alignment

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
LF-EME: Local features with elastic manifold embedding for human action recognition

Neurocomputing
Maximal Similarity Embedding

Neurocomputing
A feature space alignment learning algorithm

PRICAI'12 Proceedings of the 12th Pacific Rim international conference on Trends in Artificial Intelligence
A semi-supervised approach for dimensionality reduction with distributional similarity

Neurocomputing
Pavement distress image recognition based on multilayer autoencoders

AICI'12 Proceedings of the 4th international conference on Artificial Intelligence and Computational Intelligence
Error-correcting output codes based ensemble feature extraction

Pattern Recognition
Manifold analysis of spectral munsell colors

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part I
Spatio-temporal LTSA and its application to motion decomposition

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part V
Stability of dimensionality reduction methods applied on artificial hyperspectral images

ICCVG'12 Proceedings of the 2012 international conference on Computer Vision and Graphics
A comparative study of nonlinear manifold learning methods for cancer microarray data classification

Expert Systems with Applications: An International Journal
Increasing reliability of protein interactome by fast manifold embedding

Pattern Recognition Letters
Image Dimensionality Reduction Based on the Intrinsic Dimension and Parallel Genetic Algorithm

International Journal of Cognitive Informatics and Natural Intelligence
Robust integrated locally linear embedding

CCBR'12 Proceedings of the 7th Chinese conference on Biometric Recognition
Dimensionality reduction by low-rank embedding

IScIDE'12 Proceedings of the third Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Learning compact representation for image with tensor manifold perspective

IScIDE'12 Proceedings of the third Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Efficient semi-supervised feature selection with noise insensitive trace ratio criterion

Neurocomputing
Local Tangent Distances for Classification Problems

WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Unsupervised Feature Selection with Feature Clustering

WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Bidirectional-isomorphic manifold learning at image semantic understanding & representation

Multimedia Tools and Applications
Visualizing dimensionality reduction of systems biology data

Data Mining and Knowledge Discovery
Automatic webcam-based human heart rate measurements using laplacian eigenmap

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Visualizing the quality of dimensionality reduction

Neurocomputing
Simultaneous particle tracking in multi-action motion models with synthesized paths

Image and Vision Computing
Correspondence construction for cartoon animation via sparse coding

Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service
Multi-view hypergraph learning by patch alignment framework

Neurocomputing
Inductive manifold learning using structured support vector machine

Pattern Recognition
A multi-manifold semi-supervised Gaussian mixture model for pattern classification

Pattern Recognition Letters
Hybrid structure for robust dimensionality reduction

Neurocomputing
Semi-supervised learning with manifold fitted graphs

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Sentiment visualization and classification via semi-supervised nonlinear dimensionality reduction

Pattern Recognition
Similar handwritten Chinese character recognition by kernel discriminative locality alignment

Pattern Recognition Letters
A robust algorithm for template curve estimation based on manifold embedding

Computational Statistics & Data Analysis
On the convergence of maximum variance unfolding

The Journal of Machine Learning Research
Tapkee: an efficient dimension reduction library

The Journal of Machine Learning Research
Parallel vector field embedding

The Journal of Machine Learning Research
Orthogonal locally discriminant spline embedding for plant leaf recognition

Computer Vision and Image Understanding
Perceptual relativity-based semi-supervised dimensionality reduction algorithm

Applied Soft Computing
Local maximal margin discriminant embedding for face recognition

Journal of Visual Communication and Image Representation

Quantified Score

Hi-index	0.01

Visualization

Abstract

We present a new algorithm for manifold learning and nonlinear dimensionality reduction. Based on a set of unorganized data points sampled with noise from a parameterized manifold, the local geometry of the manifold is learned by constructing an approximation for the tangent space at each data point, and those tangent spaces are then aligned to give the global coordinates of the data points with respect to the underlying manifold. We also present an error analysis of our algorithm showing that reconstruction errors can be quite small in some cases. We illustrate our algorithm using curves and surfaces both in two-dimensional/three-dimensional (2D/3D) Euclidean spaces and in higher-dimensional Euclidean spaces. We also address several theoretical and algorithmic issues for further research and improvements.