Minimum-Volume-Constrained Nonnegative Matrix Factorization: Enhanced Ability of Learning Parts

  • Authors:

  • Guoxu Zhou;Shengli Xie;Zuyuan Yang;Jun-Mei Yang;Zhaoshui He

  • Affiliations:

  • School of Electronic and Information Engineering, South China University of Technology, Guangzhou, China;Faculty of Automation, Guangdong University of Technology, Guangzhou, China;School of Electronic and Information Engineering, South China University of Technology, Guangzhou, China;School of Electronic and Information Engineering, South China University of Technology, Guangzhou, China;Faculty of Automation, Guangdong University of Technology, Guangzhou, China

  • Venue:
  • IEEE Transactions on Neural Networks
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Nonnegative matrix factorization (NMF) with minimum-volume-constraint (MVC) is exploited in this paper. Our results show that MVC can actually improve the sparseness of the results of NMF. This sparseness is ${\rm L}_{0}$-norm oriented and can give desirable results even in very weak sparseness situations, thereby leading to the significantly enhanced ability of learning parts of NMF. The close relation between NMF, sparse NMF, and the MVC_NMF is discussed first. Then two algorithms are proposed to solve the MVC_NMF model. One is called quadratic programming_MVC_NMF (QP_MVC_NMF) which is based on quadratic programming and the other is called negative glow_MVC_NMF (NG_MVC_NMF) because it uses multiplicative updates incorporating natural gradient ingeniously. The QP_MVC_NMF algorithm is quite efficient for small-scale problems and the NG_MVC_NMF algorithm is more suitable for large-scale problems. Simulations show the efficiency and validity of the proposed methods in applications of blind source separation and human face images analysis.