Supervised Dictionary Learning via Non-negative Matrix Factorization for Classification

• Authors: Yifeng Li;Alioune Ngom
• Venue: ICMLA '12 Proceedings of the 2012 11th International Conference on Machine Learning and Applications - Volume 01
• Year: 2012

Sparse representation (SR) has been being applied as a state-of-the-art machine learning approach. Sparse representation classification (SRC1) approaches based on $l_1$ norm regularization and non-negative-least-squares (NNLS) classification approach based on non-negativity have been proposed to be powerful and robust. However, these approaches are extremely slow when the size of training samples is very large, because both of them use the whole training set as dictionary. In this paper, we briefly survey the existing SR techniques for classification, and then propose a fast approach which uses non-negative matrix factorization as supervised dictionary learning method and NNLS as non-negative sparse coding method. Experiment shows that our approach can obtain comparable accuracy with the benchmark approaches and can dramatically speed up the computation particularly in the case of large sample size and many classes.