Sparse representation and learning in visual recognition: Theory and applications

Authors:
Hong Cheng;Zicheng Liu;Lu Yang;Xuewen Chen
Affiliations:
University of Electronic Science and Technology of China, Chengdu 611731, China;Microsoft Research Redmond, One Microsoft Way, Redmond, WA 98052, USA;University of Electronic Science and Technology of China, Chengdu 611731, China;Wayne State University, Detroit, MI 48202, USA
Venue:
Signal Processing
Year:
2013

Citing 88
Cited 3

Signal representation using adaptive normalized Gaussian functions

Signal Processing
Similarity metric learning for a variable-kernel classifier

Neural Computation
A sparse representation for function approximation

Neural Computation
Atomic Decomposition by Basis Pursuit

SIAM Journal on Scientific Computing
Near-optimal sparse fourier representations via sampling

STOC '02 Proceedings of the thiry-fourth annual ACM symposium on Theory of computing
Dictionary learning algorithms for sparse representation

Neural Computation
Video Google: A Text Retrieval Approach to Object Matching in Videos

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Robust Real-Time Face Detection

International Journal of Computer Vision
Convex Optimization

Convex Optimization
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Histograms of Oriented Gradients for Human Detection

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Creating Efficient Codebooks for Visual Recognition

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Multi-task compressive sensing with Dirichlet process priors

Proceedings of the 25th international conference on Machine learning
Consistency of the Group Lasso and Multiple Kernel Learning

The Journal of Machine Learning Research
Sparse Coding in Sparse Winner Networks

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Part II--Advances in Neural Networks
Robust Face Recognition via Sparse Representation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Visual word proximity and linguistics for semantic video indexing and near-duplicate retrieval

Computer Vision and Image Understanding
Non-negative Matrix Factorization on Manifold

ICDM '08 Proceedings of the 2008 Eighth IEEE International Conference on Data Mining
Uniform Uncertainty Principle and Signal Recovery via Regularized Orthogonal Matching Pursuit

Foundations of Computational Mathematics
Learning with structured sparsity

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Online dictionary learning for sparse coding

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Classification via group sparsity promoting regularization

ICASSP '09 Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
Exploiting structure in wavelet-based Bayesian compressive sensing

IEEE Transactions on Signal Processing
On the reconstruction of block-sparse signals with an optimal number of measurements

IEEE Transactions on Signal Processing
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images

SIAM Review
ASIFT: A New Framework for Fully Affine Invariant Image Comparison

SIAM Journal on Imaging Sciences
Exact Matrix Completion via Convex Optimization

Foundations of Computational Mathematics
Compressed sensing of color images

Signal Processing
Object Detection with Discriminatively Trained Part-Based Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Compressive acquisition of dynamic scenes

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Face recognition using the feature fusion technique based on LNMF and NNSC algorithms

ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing
Kernel sparse representation for image classification and face recognition

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Robust and fast collaborative tracking with two stage sparse optimization

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Tensor sparse coding for region covariances

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Efficient highly over-complete sparse coding using a mixture model

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Hybrid compressive sampling via a new total variation TVL1

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Gabor feature based sparse representation for face recognition with gabor occlusion dictionary

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Face liveness detection from a single image with sparse low rank bilinear discriminative model

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Visual Tracking Using Sparsity Induced Similarity

ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
Three-layer Spatial Sparse Coding for Image Classification

ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
Compressive sensing on manifolds using a nonparametric mixture of factor analyzers: algorithm and performance bounds

IEEE Transactions on Signal Processing
Image categorization using directed graphs

ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
Image compressed sensing based on wavelet transform in contourlet domain

Signal Processing
Review: Surveying and comparing simultaneous sparse approximation (or group-lasso) algorithms

Signal Processing
Manifold elastic net: a unified framework for sparse dimension reduction

Data Mining and Knowledge Discovery
Video denoising using shape-adaptive sparse representation over similar spatio-temporal patches

Image Communication
Expression transfer for facial sketch animation

Signal Processing
Multi-stage image denoising based on correlation coefficient matching and sparse dictionary pruning

Signal Processing
Learning with Structured Sparsity

The Journal of Machine Learning Research
Interactive cartoon reusing by transfer learning

Signal Processing
Blind deconvolution using a normalized sparsity measure

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Discriminative affine sparse codes for image classification

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
P2C2: Programmable pixel compressive camera for high speed imaging

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Sparse image representation with epitomes

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Generalized group sparse classifiers with application in fMRI brain decoding

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Robust classification using structured sparse representation

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Are sparse representations really relevant for image classification?

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Graph connectivity in sparse subspace clustering

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Tag localization with spatial correlations and joint group sparsity

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Matching pursuits with time-frequency dictionaries

IEEE Transactions on Signal Processing
Bayesian Compressive Sensing

IEEE Transactions on Signal Processing
Sparse transfer learning for interactive video search reranking

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Greed is good: algorithmic results for sparse approximation

IEEE Transactions on Information Theory
Decoding by linear programming

IEEE Transactions on Information Theory
Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information

IEEE Transactions on Information Theory
Compressed sensing

IEEE Transactions on Information Theory
Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?

IEEE Transactions on Information Theory
Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit

IEEE Transactions on Information Theory
Non-Negative Patch Alignment Framework

IEEE Transactions on Neural Networks
Manifold Regularized Discriminative Nonnegative Matrix Factorization With Fast Gradient Descent

IEEE Transactions on Image Processing
Nonparametric Bayesian Dictionary Learning for Analysis of Noisy and Incomplete Images

IEEE Transactions on Image Processing
Sparse kernel approximations for efficient classification and detection

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Non-negative low rank and sparse graph for semi-supervised learning

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Submodular dictionary learning for sparse coding

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Sharing features in multi-class boosting via group sparsity

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Fisher Discrimination Dictionary Learning for sparse representation

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Sparse representation or collaborative representation: Which helps face recognition?

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Optical flow estimation using learned sparse model

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Sparse dictionary-based representation and recognition of action attributes

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
A linear subspace learning approach via sparse coding

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Imaging via three-dimensional compressive sampling (3DCS)

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Informative feature selection for object recognition via Sparse PCA

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Latent Low-Rank Representation for subspace segmentation and feature extraction

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Centralized sparse representation for image restoration

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Sparse Coding for Flexible, Robust 3D Facial-Expression Synthesis

IEEE Computer Graphics and Applications
Low-rank matrix decomposition in L1-norm by dynamic systems

Image and Vision Computing

Double linear regressions for single labeled image per person face recognition

Pattern Recognition
A robust elastic net approach for feature learning

Journal of Visual Communication and Image Representation
Non-negative sparse decomposition based on constrained smoothed ℓ0 norm

Signal Processing

Quantified Score

Hi-index	0.08

Visualization

Abstract

Sparse representation and learning has been widely used in computational intelligence, machine learning, computer vision and pattern recognition, etc. Mathematically, solving sparse representation and learning involves seeking the sparsest linear combination of basis functions from an overcomplete dictionary. A rational behind this is the sparse connectivity between nodes in human brain. This paper presents a survey of some recent work on sparse representation, learning and modeling with emphasis on visual recognition. It covers both the theory and application aspects. We first review the sparse representation and learning theory including general sparse representation, structured sparse representation, high-dimensional nonlinear learning, Bayesian compressed sensing, sparse subspace learning, non-negative sparse representation, robust sparse representation, and efficient sparse representation. We then introduce the applications of sparse theory to various visual recognition tasks, including feature representation and selection, dictionary learning, Sparsity Induced Similarity (SIS) measures, sparse coding based classification frameworks, and sparsity-related topics.