An information theoretic approach to a novel nonlinear independent component analysis paradigm

Authors:
Daniele Vigliano;Raffaele Parisi;Aurelio Uncini
Affiliations:
Dipartimento INFOCOM, Università di Roma "La sapienza", Via Eudossiana, Rome, Italy and Via Carlo de Marchesetti, Rome, Italy;Dipartimento INFOCOM, Università di Roma "La sapienza", Via Eudossiana, Rome, Italy;Dipartimento INFOCOM, Università di Roma "La sapienza", Via Eudossiana, Rome, Italy
Venue:
Signal Processing - Special issue: Information theoretic signal processing
Year:
2005

Citing 21
Cited 1

Blind separation of sources, Part 1: an adaptive algorithm based on neuromimetic architecture

Signal Processing
Independent component analysis, a new concept?

Signal Processing - Special issue on higher order statistics
An information-maximization approach to blind separation and blind deconvolution

Neural Computation
Multichannel blind deconvolution: FIR matrix algebra and separation of multipath mixtures

Signal Processing
Natural gradient works efficiently in learning

Neural Computation
Learning and approximation capabilities of adaptive spline activation function neutral networks

Neural Networks
Nonlinear independent component analysis: existence and uniqueness results

Neural Networks
Blind signal processing by the adaptive activation function neurons

Neural Networks
Flexible Independent Component Analysis

Journal of VLSI Signal Processing Systems
Blind Deconvolution, Information Maximization and Recursive Filters

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 4 - Volume 4
New Geometrical Approach for Blind Separation of Sources Mapped to a Neural Network

NICROSP '96 Proceedings of the 1996 International Workshop on Neural Networks for Identification, Control, Robotics, and Signal/Image Processing (NICROSP '96)
Two spatio-temporal decorrelation learning algorithms and their application to multichannel blind deconvolution

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 02
Source separation in post-nonlinear mixtures

IEEE Transactions on Signal Processing
Complex-valued neural networks with adaptive spline activationfunction for digital-radio-links nonlinear equalization

IEEE Transactions on Signal Processing
A generic framework for blind source separation in structurednonlinear models

IEEE Transactions on Signal Processing
Equivariant adaptive source separation

IEEE Transactions on Signal Processing
Information geometry on hierarchy of probability distributions

IEEE Transactions on Information Theory
Fast and robust fixed-point algorithms for independent component analysis

IEEE Transactions on Neural Networks
Multilayer feedforward networks with adaptive spline activation function

IEEE Transactions on Neural Networks
Nonlinear blind source separation using a radial basis function network

IEEE Transactions on Neural Networks
Blind signal processing by complex domain adaptive spline neural networks

IEEE Transactions on Neural Networks

A recurrent ICA approach to a novel BSS convolutive nonlinear problem

WIRN'05 Proceedings of the 16th Italian conference on Neural Nets

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces a novel independent component analysis (ICA) approach to the separation of nonlinear convolutive mixtures. The proposed model is an extension of the well-known post nonlinear (PNL) mixing model and consists of the convolutive mixing of PNL mixtures. Theoretical proof of existence and uniqueness of the solution under proper assumptions is provided. Feedforward and recurrent demixing architectures based on spline neurons are introduced and compared. Source separation is performed by minimizing the mutual information of the output signals with respect to the network parameters. More specifically, the proposed architectures perform on-line nonlinear compensation and score function estimation by proper use of flexible spline nonlinearities, yielding a significant performance improvement in terms of source pdf matching and algorithm speed of convergence. Experimental tests on different signals are described to demonstrate the effectiveness of the proposed approach.