Natural Gradient Learning for Over-and Under-Complete Bases in ICA

Authors:
Shun-Ichi Amari
Affiliations:
RIKEN Brain Science Institute, Wako-shi, Hirosawa, Saitama 351-01, Japan
Venue:
Neural Computation
Year:
1999

Citing 10
Cited 11

Blind separation of sources, Part 1: an adaptive algorithm based on neuromimetic architecture

Signal Processing
Independent component analysis, a new concept?

Signal Processing - Special issue on higher order statistics
An information-maximization approach to blind separation and blind deconvolution

Neural Computation
Adaptive online learning algorithms for blind separation: maximum entropy and minimum mutual information

Neural Computation
Stability analysis of learning algorithms for blind source separation

Neural Networks
Natural gradient works efficiently in learning

Neural Computation
An equivalence between sparse approximation and support vector machines

Neural Computation
Learning nonlinear overcomplete representations for efficient coding

NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
The Geometry of Algorithms with Orthogonality Constraints

SIAM Journal on Matrix Analysis and Applications
Equivariant adaptive source separation

IEEE Transactions on Signal Processing

Flexible Independent Component Analysis

Journal of VLSI Signal Processing Systems
Statistical dynamics of on-line independent component analysis

The Journal of Machine Learning Research
Fast communication: Stability analysis of natural gradient learning rules in overdetermined ICA

Signal Processing
On blind source separation using generalized eigenvalues with a new metric

Neurocomputing
Global and local preserving feature extraction for image categorization

ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
An offline independent component analysis algorithm for colored sources

IITA'09 Proceedings of the 3rd international conference on Intelligent information technology application
Determining number of independent sources in undercomplete mixture

EURASIP Journal on Advances in Signal Processing
A Generalized Path Integral Control Approach to Reinforcement Learning

The Journal of Machine Learning Research
Flexible-ICA algorithm for a reliable iris recognition

Transactions on large-scale data- and knowledge-centered systems IV
An extended online Fast-ICA algorithm

ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
Underdetermined blind separation of speech signals with delays in different time-frequency domains

Nonlinear Speech Modeling and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Independent component analysis or blind source separation is a new technique of extracting independent signals from mixtures. It is applicable even when the number of independent sources is unknown and is larger or smaller than the number of observed mixture signals. This article extends the natural gradient learning algorithm to be applicable to these overcomplete and undercomplete cases. Here, the observed signals are assumed to be whitened by preprocessing, so that we use the natural Riemannian gradient in Stiefel manifolds.