Non-parametric approach to ICA using kernel density estimation

Authors:
K. Sengupta;P. Burman
Affiliations:
Adv. Interfaces Inc., State College, PA, USA;Dept. of Comput. Sci. & Eng., Fudan Univ., Shanghai, China
Venue:
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Year:
2003

Citing 4
Cited 1

Principles of multivariate analysis: a user's perspective

Principles of multivariate analysis: a user's perspective
An information-maximization approach to blind separation and blind deconvolution

Neural Computation
Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources

Neural Computation
Blind separation of mixture of independent sources through aquasi-maximum likelihood approach

IEEE Transactions on Signal Processing

Recent advances in subspace analysis for face recognition

SINOBIOMETRICS'04 Proceedings of the 5th Chinese conference on Advances in Biometric Person Authentication

Quantified Score

Hi-index	0.00

Visualization

Abstract

Independent component analysis (ICA) has found a wide range of applications in signal processing and multimedia, ranging from speech cleaning to face recognition. This paper presents a non-parametric approach to the ICA problem that is robust towards outlier effects. The algorithm, for the first time in the field of ICA, adopts an intuitive and direct approach, focusing on the very definition of independence itself; i.e. the joint probability density function (pdf) of independent sources is factorial over the marginal distributions. This is contrary to traditional independent component analysis (ICA) algorithms, which achieve the objective by attempting to fulfill necessary conditions (but not sufficient) for independence. For example, the Jade algorithm attempts to approximate independence by minimizing higher order statistics. In the proposed algorithm, kernel density estimation is employed to provide a good approximation of the distributions that are required to be estimated. This estimation technique is inherently robust towards outlier effects. The application of kernel density estimation also enables the algorithm to be free from the assumptions of source distributions. Experimental results show that the algorithm is able to perform separation of sources in the presence of outliers, whereas existing algorithms like Jade and Info max break down under such conditions. The results have also shown that the proposed non-parametric approach is generally source distribution independent. In addition, it is able to separate non-Gaussian zero-kurtotic signals unlike the traditional ICA algorithms like Jade and Infomax.