Learning and relearning in Boltzmann machines
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
What is the goal of sensory coding?
Neural Computation
Independent component analysis, a new concept?
Signal Processing - Special issue on higher order statistics
Inferring sparse, overcomplete image codes using an efficient coding framework
NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
Numerical Recipes in C: The Art of Scientific Computing
Numerical Recipes in C: The Art of Scientific Computing
IEEE Transactions on Pattern Analysis and Machine Intelligence
Ensemble of Independent Factor Analyzers with Application to Natural Image Analysis
Neural Processing Letters
Estimating Overcomplete Independent Component Bases for Image Windows
Journal of Mathematical Imaging and Vision
Mean-field approaches to independent component analysis
Neural Computation
Dictionary learning algorithms for sparse representation
Neural Computation
Overcomplete ICA with a Geometric Algorithm
ICANN '02 Proceedings of the International Conference on Artificial Neural Networks
TSCTC '02 Proceedings of the Third International Conference on Rough Sets and Current Trends in Computing
SVM '02 Proceedings of the First International Workshop on Pattern Recognition with Support Vector Machines
Independent multiresolution component analysis and matching pursuit
Computational Statistics & Data Analysis - Special issue: Computational econometrics
Energy-based models for sparse overcomplete representations
The Journal of Machine Learning Research
A multiscale framework for blind separation of linearly mixed signals
The Journal of Machine Learning Research
A maximum likelihood approach to single-channel source separation
The Journal of Machine Learning Research
A generative model for separating illumination and reflectance from images
The Journal of Machine Learning Research
Natural Computing: an international journal
Analysis of sparse representation and blind source separation
Neural Computation
Adaptive blind separation with an unknown number of sources
Neural Computation
Energy-based models for sparse overcomplete representations
The Journal of Machine Learning Research
A multiscale framework for blind separation of linearly mixed signals
The Journal of Machine Learning Research
A maximum likelihood approach to single-channel source separation
The Journal of Machine Learning Research
A generative model for separating illumination and reflectance from images
The Journal of Machine Learning Research
Sparse Multinomial Logistic Regression: Fast Algorithms and Generalization Bounds
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Knowledge and Data Engineering
Topographic Product Models Applied to Natural Scene Statistics
Neural Computation
An Adaptive Method for Subband Decomposition ICA
Neural Computation
Efficient Coding of Time-Relative Structure Using Spikes
Neural Computation
Bilinear Sparse Coding for Invariant Vision
Neural Computation
Blind Source Separation by Sparse Decomposition in a Signal Dictionary
Neural Computation
A Constrained EM Algorithm for Independent Component Analysis
Neural Computation
A Variational Method for Learning Sparse and Overcomplete Representations
Neural Computation
Blind source separation of more sources than mixtures using sparse mixture models
Pattern Recognition Letters
General design algorithm for sparse frame expansions
Signal Processing
Sparse audio representations using the MCLT
Signal Processing - Sparse approximations in signal and image processing
On the use of sparse signal decomposition in the analysis of multi-channel surface electromyograms
Signal Processing - Sparse approximations in signal and image processing
Blind identification of under-determined mixtures based on the characteristic function
Signal Processing - Signal processing in UWB communications
Learning Sparse Overcomplete Codes for Images
Journal of VLSI Signal Processing Systems
Digital Signal Processing
Nonlinear underdetermined blind signal separation using Bayesian neural network approach
Digital Signal Processing
Learning Sparse Overcomplete Codes for Images
Journal of VLSI Signal Processing Systems
Source separation using single channel ICA
Signal Processing
A parametric density model for blind source separation
Neural Processing Letters
Information maximization in face processing
Neurocomputing
A null space method for over-complete blind source separation
Computational Statistics & Data Analysis
Sparse spectrotemporal coding of sounds
EURASIP Journal on Applied Signal Processing
Visual Recognition and Inference Using Dynamic Overcomplete Sparse Learning
Neural Computation
EURASIP Journal on Applied Signal Processing
3D-audio matting, postediting, and rerendering from field recordings
EURASIP Journal on Applied Signal Processing
Overcomplete topographic independent component analysis
Neurocomputing
Sparse Bayesian nonparametric regression
Proceedings of the 25th international conference on Machine learning
Estimation of causal effects using linear non-Gaussian causal models with hidden variables
International Journal of Approximate Reasoning
Computational Intelligence and Security
Topographic Infomax in a Neural Multigrid
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Part II--Advances in Neural Networks
An Efficient K-Hyperplane Clustering Algorithm and Its Application to Sparse Component Analysis
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Part II--Advances in Neural Networks
Underdetermined Blind Source Separation Using SVM
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks, Part III
An Overcomplete ICA Algorithm by InfoMax and InfoMin
ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
Sparse Coding Neural Gas for the Separation of Noisy Overcomplete Sources
ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
Learning to Combine Motor Primitives Via Greedy Additive Regression
The Journal of Machine Learning Research
A fixed-point algorithm for blind source separation with nonlinear autocorrelation
Journal of Computational and Applied Mathematics
Manifold models for signals and images
Computer Vision and Image Understanding
K-hyperline clustering learning for sparse component analysis
Signal Processing
Journal of Mathematical Imaging and Vision
Fast nonlinear autocorrelation algorithm for source separation
Pattern Recognition
Approaching the Time Dependent Cocktail Party Problem with Online Sparse Coding Neural Gas
WSOM '09 Proceedings of the 7th International Workshop on Advances in Self-Organizing Maps
Journal of Computational Physics
Underdetermined blind source separation based on subspace representation
IEEE Transactions on Signal Processing
Dictionary learning for sparse approximations with the majorization method
IEEE Transactions on Signal Processing
IEEE Transactions on Image Processing
Learning Deep Architectures for AI
Foundations and Trends® in Machine Learning
Multimodal Sparse Features for Object Detection
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part II
A simple overcomplete ICA algorithm by non-orthogonal pair optimizations
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
An iterative Bayesian algorithm for sparse component analysis in presence of noise
IEEE Transactions on Signal Processing
Parametric dictionary design for sparse coding
IEEE Transactions on Signal Processing
IEEE Transactions on Image Processing
An associative sparse coding neural network and applications
Neurocomputing
Online Learning for Matrix Factorization and Sparse Coding
The Journal of Machine Learning Research
The CLEAR 2006 CMU acoustic environment classification system
CLEAR'06 Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships
Independent component analysis and support vector machine for face feature extraction
AVBPA'03 Proceedings of the 4th international conference on Audio- and video-based biometric person authentication
Gamma Markov random fields for audio source modeling
IEEE Transactions on Audio, Speech, and Language Processing
Compressed sensing and source separation
ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
Dictionary learning for L1-exact sparse coding
ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
Blind matrix decomposition via genetic optimization of sparseness and nonnegativity constraints
ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Determining number of independent sources in undercomplete mixture
EURASIP Journal on Advances in Signal Processing
Role of homeostasis in learning sparse representations
Neural Computation
Learning sparse representation using iterative subspace identification
IEEE Transactions on Signal Processing
A directional laplacian density for underdetermined audio source separation
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part I
Adaptive underdetermined ICA for handling an unknown number of sources
LVA/ICA'10 Proceedings of the 9th international conference on Latent variable analysis and signal separation
Dictionary learning for sparse representations: a Pareto curve root finding approach
LVA/ICA'10 Proceedings of the 9th international conference on Latent variable analysis and signal separation
Robust visual monitoring of machine condition with sparse coding and self-organizing map
ICIRA'10 Proceedings of the Third international conference on Intelligent robotics and applications - Volume Part I
Learning the Morphological Diversity
SIAM Journal on Imaging Sciences
An adaptive algorithm for speech source separation in overcomplete cases using wavelet packets
SIP'06 Proceedings of the 5th WSEAS international conference on Signal processing
SIP'06 Proceedings of the 5th WSEAS international conference on Signal processing
FIR convolutive BSS based on sparse representation
ISNN'05 Proceedings of the Second international conference on Advances in neural networks - Volume Part II
Compressed sensing meets the human visual system
ICHIT'11 Proceedings of the 5th international conference on Convergence and hybrid information technology
A novel predual dictionary learning algorithm
Journal of Visual Communication and Image Representation
The Sample Complexity of Dictionary Learning
The Journal of Machine Learning Research
Fast and adaptive low-pass whitening filters for natural images
ICONIP'06 Proceedings of the 13th international conference on Neural Information Processing - Volume Part II
Image representation in visual cortex and high nonlinear approximation
ISNN'05 Proceedings of the Second international conference on Advances in Neural Networks - Volume Part I
Second-Order blind identification of underdetermined mixtures
ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Post-nonlinear underdetermined ICA by bayesian statistics
ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Analysis of source sparsity and recoverability for SCA based blind source separation
ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Learning overcomplete representations with a generalized gaussian prior
TAMC'06 Proceedings of the Third international conference on Theory and Applications of Models of Computation
Identification of mixing matrix in blind source separation
ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
Learning multi-modal dictionaries: application to audiovisual data
MRCS'06 Proceedings of the 2006 international conference on Multimedia Content Representation, Classification and Security
Signal sparsity enhancement through wavelet transforms in underdetermined BSS
Nonlinear Speech Modeling and Applications
Sparse source separation with unknown source number
ICSI'10 Proceedings of the First international conference on Advances in Swarm Intelligence - Volume Part II
BTF compression via sparse tensor decomposition
EGSR'09 Proceedings of the Twentieth Eurographics conference on Rendering
ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition
Multi-resolutive sparse approximations of d-dimensional data
Computer Vision and Image Understanding
Decomposition and dictionary learning for 3D trajectories
Signal Processing
| Hi-index | 0.02 |
In an overcomplete basis, the number of basis vectors is greater than the dimensionality of the input, and the representation of an input is not a unique combination of basis vectors. Overcomplete representations have been advocated because they have greater robustness in the presence of noise, can be sparser, and can have greater flexibility in matching structure in the data. Overcomplete codes have also been proposed as a model of some of the response properties of neurons in primary visual cortex. Previous work has focused on finding the best representation of a signal using a fixed overcomplete basis (or dictionary). We present an algorithm for learning an overcomplete basis by viewing it as probabilistic model of the observed data. We show that overcomplete bases can yield a better approximation of the underlying statistical distribution of the data and can thus lead to greater coding efficiency. This can be viewed as a generalization of the technique of independent component analysis and provides a method for Bayesian reconstruction of signals in the presence of noise and for blind source separation when there are more sources than mixtures.