Locality preserving nonnegative matrix factorization

  • Authors:
  • Deng Cai;Xiaofei He;Xuanhui Wang;Hujun Bao;Jiawei Han

  • Affiliations:
  • State Key Lab of CAD&CG, College of Computer Science, Zhejiang University, China;State Key Lab of CAD&CG, College of Computer Science, Zhejiang University, China;Department of Computer Science, University of Illinois at Urbana-Champaign;State Key Lab of CAD&CG, College of Computer Science, Zhejiang University, China;Department of Computer Science, University of Illinois at Urbana-Champaign

  • Venue:
  • IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Matrix factorization techniques have been frequently applied in information processing tasks. Among them, Non-negative Matrix Factorization (NMF) have received considerable attentions due to its psychological and physiological interpretation of naturally occurring data whose representation may be parts-based in human brain. On the other hand, from geometric perspective the data is usually sampled from a low dimensional manifold embedded in high dimensional ambient space. One hopes then to find a compact representation which uncovers the hidden topics and simultaneously respects the intrinsic geometric structure. In this paper, we propose a novel algorithm, called Locality Preserving Non-negative Matrix Factorization (LPNMF), for this purpose. For two data points, we use KL-divergence to evaluate their similarity on the hidden topics. The optimal maps are obtained such that the feature values on hidden topics are restricted to be non-negative and vary smoothly along the geodesics of the data manifold. Our empirical study shows the encouraging results of the proposed algorithm in comparisons to the state-of-the-art algorithms on two large high-dimensional databases.