A non-convex relaxation approach to sparse dictionary learning

  • Authors:
  • Jianping Shi; Xiang Ren; Guang Dai; Jingdong Wang; Zhihua Zhang

  • Affiliations:
  • Dept. of Comput. Sci. & Technol., Zhejiang Univ., Hangzhou, China;Dept. of Comput. Sci. & Technol., Zhejiang Univ., Hangzhou, China;Dept. of Comput. Sci. & Technol., Zhejiang Univ., Hangzhou, China;-;Dept. of Comput. Sci. & Technol., Zhejiang Univ., Hangzhou, China

  • Venue:
  • CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Dictionary learning is a challenging theme in computer vision. The basic goal is to learn a sparse representation from an overcomplete basis set. Most existing approaches employ a convex relaxation scheme to tackle this challenge due to the strong ability of convexity in computation and theoretical analysis. In this paper we propose a non-convex online approach for dictionary learning. To achieve the sparseness, our approach treats a so-called minimax concave (MC) penalty as a nonconvex relaxation of the $/ell_0)$ penalty. This treatment expects to obtain a more robust and sparse representation than existing convex approaches. In addition, we employ an online algorithm to adaptively learn the dictionary, which makes the non-convex formulation computationally feasible. Experimental results on the sparseness comparison and the applications in image denoising and image inpainting demonstrate that our approach is more effective and flexible.