Efficient locally linear embeddings of imperfect manifolds

  • Authors:
  • Abdenour Hadid;Matti Pietikäinen

  • Affiliations:
  • Machine Vision Group, Infotech Oulu, University of Oulu, Finland;Machine Vision Group, Infotech Oulu, University of Oulu, Finland

  • Venue:
  • MLDM'03 Proceedings of the 3rd international conference on Machine learning and data mining in pattern recognition
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we explore the capabilities of a recently proposed method for non-linear dimensionality reduction and visualization called Locally Linear Embedding (LLE). LLE is proposed as an alternative to the traditional approaches. Its ability to deal with large sizes of high dimensional data and non-iterative way to find the embeddings make it more and more attractive to several researchers. All the studies which investigated and experimented this approach have concluded that LLE is a robust and efficient algorithm when the data lie on a smooth and well-sampled single manifold. None explored the behavior of the algorithm when the data include some noise (or outliers). Here, we show theoretically and empirically that LLE is significantly sensitive to the presence of a few outliers. Then we propose a robust extension to tackle this problem. Further, we investigate the behavior of the LLE algorithm in cases of disjoint manifolds, demonstrate the lack of single global coordinate system and discuss some alternatives.