LDR-LLE: LLE with Low-Dimensional Neighborhood Representation

  • Authors:
  • Yair Goldberg;Ya'Acov Ritov

  • Affiliations:
  • Department of Statistics and The Center for the Study of Rationality, Hebrew University, Jerusalem, Israel;Department of Statistics and The Center for the Study of Rationality, Hebrew University, Jerusalem, Israel

  • Venue:
  • ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

The local linear embedding algorithm (LLE) is a non-linear dimension-reducing technique that is widely used for its computational simplicity and intuitive approach. LLE first linearly reconstructs each input point from its nearest neighbors and then preserves these neighborhood relations in a low-dimensional embedding. We show that the reconstruction weights computed by LLE capture the high -dimensional structure of the neighborhoods, and not the low -dimensional manifold structure. Consequently, the weight vectors are highly sensitive to noise. Moreover, this causes LLE to converge to a linear projection of the input, as opposed to its non-linear embedding goal. To resolve both of these problems, we propose to compute the weight vectors using a low-dimensional neighborhood representation. We call this technique LDR-LLE. We present numerical examples of the perturbation and linear projection problems, and of the improved outputs resulting from the low-dimensional neighborhood representation.