Learning sparse features for classification by mixture models

  • Authors:
  • Weixiang Liu;Nanning Zheng

  • Affiliations:
  • Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710049, PR China;Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi Province 710049, PR China

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2004

Quantified Score

Hi-index 0.10

Visualization

Abstract

Non-negative matrix factorization (NMF) can discover sparse features for classification via mixture models and the sparseness of features controls the learning rate of the basis function parameters. But the original NMF in which the basis vectors are unit ones in L1 norm, does not increase the sparseness of learned features. This paper generalizes NMF to Lp-NMF where the basis vectors are unit ones in Lp norm. Experiments demonstrate how p affects the sparseness of learned features and the final classification accuracy. And the results show that L2-NMF is superior one for practical implementation.