Exploring Latent Structure of Mixture ICA Models by the Minimum β-Divergence Method

Authors:
Md. Nurul Haque Mollah;Mihoko Minami;Shinto Eguchi
Affiliations:
Department of Statistical Science, Graduate University for Advanced Studies, Minato-ku, Tokyo 106-8569, Japan;Institute of Statistical Mathematics and the Graduate University for Advanced Studies, Minato-ku, Tokyo 106-8569, Japan;Institute of Statistical Mathematics and the Graduate University for Advanced Studies, Minato-ku, Tokyo 106-8569, Japan
Venue:
Neural Computation
Year:
2006

Citing 7
Cited 6

Blind separation of sources, Part 1: an adaptive algorithm based on neuromimetic architecture

Signal Processing
An information-maximization approach to blind separation and blind deconvolution

Neural Computation
Independent component analysis: theory and applications

Independent component analysis: theory and applications
Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources

Neural Computation
ICA Mixture Models for Unsupervised Classification of Non-Gaussian Classes and Automatic Context Switching in Blind Signal Separation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Robust blind source separation by beta divergence

Neural Computation
Blind source separation-semiparametric statistical approach

IEEE Transactions on Signal Processing

Robust Prewhitening for ICA by Minimizing β-Divergence and Its Application to FastICA

Neural Processing Letters
Discovery of Linear Non-Gaussian Acyclic Models in the Presence of Latent Classes

Neural Information Processing
A general procedure for learning mixtures of independent component analyzers

Pattern Recognition
Fast communication: On including sequential dependence in ICA mixture models

Signal Processing
Image similarity based on hierarchies of ICA mixtures

ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
Review: Divergence measures for statistical data processing-An annotated bibliography

Signal Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Independent component analysis (ICA) attempts to extract original independent signals (source components) that are linearly mixed in a basic framework. This letter discusses a learning algorithm for the separation of different source classes in which the observed data follow a mixture of several ICA models, where each model is described by a linear combination of independent and nongaussian sources. The proposed method is based on a sequential application of the minimum β-divergence method to separate all source classes sequentially. The proposed method searches the recovering matrix of each class on the basis of a rule of sequential change of the shifting parameter. If the initial choice of the shifting parameter vector is close to the mean of a data class, then all of the hidden sources belonging to that class are recovered properly with independent and nongaussian structure considering the data in other classes as outliers. The value of the tuning parameter β is a key in the performance of the proposed method. A cross-validation technique is proposed as an adaptive selection procedure for the tuning parameter β for this algorithm, together with applications for both real and synthetic data analysis.