Automatic rank determination in projective nonnegative matrix factorization

  • Authors:
  • Zhirong Yang;Zhanxing Zhu;Erkki Oja

  • Affiliations:
  • Department of Information and Computer Science, Aalto University School of Science and Technology, Aalto, Finland;Department of Information and Computer Science, Aalto University School of Science and Technology, Aalto, Finland;Department of Information and Computer Science, Aalto University School of Science and Technology, Aalto, Finland

  • Venue:
  • LVA/ICA'10 Proceedings of the 9th international conference on Latent variable analysis and signal separation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Projective Nonnegative Matrix Factorization (PNMF) has demonstrated advantages in both sparse feature extraction and clustering. However, PNMF requires users to specify the column rank of the approximative projection matrix, the value of which is unknown before-hand. In this paper, we propose a method called ARDPNMF to automatically determine the column rank in PNMF. Our method is based on automatic relevance determination (ARD) with Jeffrey's prior. After deriving the multiplicative update rule using the expectation-maximization technique for ARDPNMF, we test it on various synthetic and real-world datasets for feature extraction and clustering applications to show the effectiveness of our algorithm. For FERET faces and the Swimmer dataset, interpretable number of features are obtained correctly via our algorithm. Several UCI datasets for clustering are also tested, in which we find that ARDPNMF can estimate the number of clusters quite accurately with low deviation and good cluster purity.