On-line learning and stochastic approximations
On-line learning in neural networks
Atomic Decomposition by Basis Pursuit
SIAM Journal on Scientific Computing
A view of the EM algorithm that justifies incremental, sparse, and other variants
Learning in graphical models
From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose
IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning and example selection for object and pattern detection
Learning and example selection for object and pattern detection
Non-negative Matrix Factorization with Sparseness Constraints
The Journal of Machine Learning Research
Acquiring Linear Subspaces for Face Recognition under Variable Lighting
IEEE Transactions on Pattern Analysis and Machine Intelligence
Blind Source Separation by Sparse Decomposition in a Signal Dictionary
Neural Computation
Learning Overcomplete Representations
Neural Computation
Algorithms for simultaneous sparse approximation: part I: Greedy pursuit
Signal Processing - Sparse approximations in signal and image processing
Algorithms for simultaneous sparse approximation: part II: Convex relaxation
Signal Processing - Sparse approximations in signal and image processing
Self-taught learning: transfer learning from unlabeled data
Proceedings of the 24th international conference on Machine learning
Projected Gradient Methods for Nonnegative Matrix Factorization
Neural Computation
Efficient projections onto the l1-ball for learning in high dimensions
Proceedings of the 25th international conference on Machine learning
The Group-Lasso for generalized linear models: uniqueness of solutions and efficient algorithms
Proceedings of the 25th international conference on Machine learning
Consistency of the Group Lasso and Multiple Kernel Learning
The Journal of Machine Learning Research
Optimal Solutions for Sparse Principal Component Analysis
The Journal of Machine Learning Research
Journal of Mathematical Imaging and Vision
Group lasso with overlap and graph lasso
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Online dictionary learning for sparse coding
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Image sequence denoising via sparse and redundant representations
IEEE Transactions on Image Processing
Sparse and Redundant Modeling of Image Content Using an Image-Signature-Dictionary
SIAM Journal on Imaging Sciences
Joint covariate selection and joint subspace selection for multiple classification problems
Statistics and Computing
-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
IEEE Transactions on Signal Processing
Sparse solutions to linear inverse problems with multiple measurement vectors
IEEE Transactions on Signal Processing
Recovery of exact sparse representations in the presence of bounded noise
IEEE Transactions on Information Theory
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
IEEE Transactions on Image Processing
Sparse Representation for Color Image Restoration
IEEE Transactions on Image Processing
Efficient highly over-complete sparse coding using a mixture model
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
SMALLbox - an evaluation framework for sparse representations and dictionary learning algorithms
LVA/ICA'10 Proceedings of the 9th international conference on Latent variable analysis and signal separation
Learning the Morphological Diversity
SIAM Journal on Imaging Sciences
Learning adaptive and sparse representations of medical images
MCV'10 Proceedings of the 2010 international MICCAI conference on Medical computer vision: recognition techniques and applications in medical imaging
Proximal Methods for Hierarchical Sparse Coding
The Journal of Machine Learning Research
Dictionary learning in texture classification
ICIAR'11 Proceedings of the 8th international conference on Image analysis and recognition - Volume Part I
PADDLE: proximal algorithm for dual dictionaries learning
ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
Multi-subject dictionary learning to segment an atlas of brain spontaneous activity
IPMI'11 Proceedings of the 22nd international conference on Information processing in medical imaging
High resolution segmentation of neuronal tissues from low depth-resolution EM imagery
EMMCVPR'11 Proceedings of the 8th international conference on Energy minimization methods in computer vision and pattern recognition
DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Visual tracking based on Log-Euclidean Riemannian sparse representation
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
DCE-MRI analysis using sparse adaptive representations
MLMI'11 Proceedings of the Second international conference on Machine learning in medical imaging
Emerging topic detection using dictionary learning
Proceedings of the 20th ACM international conference on Information and knowledge management
Bottom-up saliency based on weighted sparse coding residual
MM '11 Proceedings of the 19th ACM international conference on Multimedia
A novel predual dictionary learning algorithm
Journal of Visual Communication and Image Representation
Algorithms for nonnegative matrix factorization with the β-divergence
Neural Computation
Convex and Network Flow Optimization for Structured Sparsity
The Journal of Machine Learning Research
Structured Variable Selection with Sparsity-Inducing Norms
The Journal of Machine Learning Research
The Sample Complexity of Dictionary Learning
The Journal of Machine Learning Research
Proceedings of the fifth ACM international conference on Web search and data mining
Optimization with Sparsity-Inducing Penalties
Foundations and Trends® in Machine Learning
Histology image indexing using a non-negative semantic embedding
MCBR-CDS'11 Proceedings of the Second MICCAI international conference on Medical Content-Based Retrieval for Clinical Decision Support
Online PLCA for real-time semi-supervised source separation
LVA/ICA'12 Proceedings of the 10th international conference on Latent Variable Analysis and Signal Separation
LVA/ICA'12 Proceedings of the 10th international conference on Latent Variable Analysis and Signal Separation
Non-uniform Deblurring for Shaken Images
International Journal of Computer Vision
Arbitrary body segmentation in static images
Pattern Recognition
Sparse Modeling of Human Actions from Motion Imagery
International Journal of Computer Vision
Active learning for online bayesian matrix factorization
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Towards heterogeneous temporal clinical event pattern discovery: a convolutional approach
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Large-scale distributed non-negative sparse coding and sparse dictionary learning
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Self-taught dimensionality reduction on the high-dimensional small-sized data
Pattern Recognition
Tensor based sparse decomposition of 3D shape for visual detection of mirror symmetry
Computer Methods and Programs in Biomedicine
Sparsity cue in image copy detection
Proceedings of the 20th ACM international conference on Multimedia
Sparselet models for efficient multiclass object detection
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Sparse DSI: learning DSI structure for denoising and fast imaging
MICCAI'12 Proceedings of the 15th international conference on Medical Image Computing and Computer-Assisted Intervention - Volume Part II
Regularized Latent Semantic Indexing: A New Approach to Large-Scale Topic Modeling
ACM Transactions on Information Systems (TOIS)
Super resolution via sparse representation in l1 framework
Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
Online projective nonnegative matrix factorization for large datasets
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
Face recognition via Weighted Sparse Representation
Journal of Visual Communication and Image Representation
SCoBeP: Dense image registration using sparse coding and belief propagation
Journal of Visual Communication and Image Representation
Comparison of mid-level feature coding approaches and pooling strategies in visual concept detection
Computer Vision and Image Understanding
Pooling in image representation: The visual codeword point of view
Computer Vision and Image Understanding
Sparse hashing for fast multimedia search
ACM Transactions on Information Systems (TOIS)
Two-layer sparse compression of dense-weight blend skinning
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Multi-Level structured image coding on high-dimensional image representation
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Image upscaling using multiple dictionaries of natural image patches
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Optimal contrast based saliency detection
Pattern Recognition Letters
Sparse representation for recognizing object-to-object actions under occlusions
Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service
Spatial codebook for robust background detection in visual information analysis
Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service
Cross-media topic mining on wikipedia
Proceedings of the 21st ACM international conference on Multimedia
Truncated power method for sparse eigenvalue problems
The Journal of Machine Learning Research
Sparse activity and sparse connectivity in supervised learning
The Journal of Machine Learning Research
Stochastic variational inference
The Journal of Machine Learning Research
Biomedical time series clustering based on non-negative sparse coding and probabilistic topic model
Computer Methods and Programs in Biomedicine
Cohort-level brain mapping: learning cognitive atoms to single out specialized regions
IPMI'13 Proceedings of the 23rd international conference on Information Processing in Medical Imaging
A robust image classification scheme with sparse coding and multiple kernel learning
IWDW'12 Proceedings of the 11th international conference on Digital Forensics and Watermaking
Skill-based Mission Generation: A Data-driven Temporal Player Modeling Approach
Proceedings of the The third workshop on Procedural Content Generation in Games
Discriminative sparse coding on multi-manifolds
Knowledge-Based Systems
A novel sparse model based forensic writer identification
Pattern Recognition Letters
Supervised feature selection in graphs with path coding penalties and network flows
The Journal of Machine Learning Research
A time-based collective factorization for topic discovery and monitoring in news
Proceedings of the 23rd international conference on World wide web
Online dictionary learning algorithm with periodic updates and its application to image denoising
Expert Systems with Applications: An International Journal
Online Dictionary Learning Based Intra-frame Video Coding
Wireless Personal Communications: An International Journal
Poisson Noise Reduction with Non-local PCA
Journal of Mathematical Imaging and Vision
Recovering non-negative and combined sparse representations
Digital Signal Processing
From machine learning to machine reasoning
Machine Learning
A tour of machine learning: An AI perspective
AI Communications - ECAI 2012 Turing and Anniversary Track
Novel document detection for massive data streams using distributed dictionary learning
IBM Journal of Research and Development
Local signature quantization by sparse coding
3DOR '13 Proceedings of the Sixth Eurographics Workshop on 3D Object Retrieval
Hi-index | 0.00 |
Sparse coding--that is, modelling data vectors as sparse linear combinations of basis elements--is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on the large-scale matrix factorization problem that consists of learning the basis set in order to adapt it to specific data. Variations of this problem include dictionary learning in signal processing, non-negative matrix factorization and sparse principal component analysis. In this paper, we propose to address these tasks with a new online optimization algorithm, based on stochastic approximations, which scales up gracefully to large data sets with millions of training samples, and extends naturally to various matrix factorization formulations, making it suitable for a wide range of learning problems. A proof of convergence is presented, along with experiments with natural images and genomic data demonstrating that it leads to state-of-the-art performance in terms of speed and optimization for both small and large data sets.