A cascaded ensemble learning for independent component analysis

Authors:
Jian Cheng;Kongqiao Wang;Yenwei Chen
Affiliations:
Nokia Research Center, Beijing, China;Nokia Research Center, Beijing, China;College of Information Science and Engineering, Ritsumeikan University, Japan
Venue:
ISNN'05 Proceedings of the Second international conference on Advances in Neural Networks - Volume Part I
Year:
2005

Citing 4
Cited 0

Independent component analysis, a new concept?

Signal Processing - Special issue on higher order statistics
An information-maximization approach to blind separation and blind deconvolution

Neural Computation
Bagging predictors

Machine Learning
The Random Subspace Method for Constructing Decision Forests

IEEE Transactions on Pattern Analysis and Machine Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

In case of application to high-dimensional pattern recognition task, Independent Component Analysis (ICA) often suffers from two challenging problems. One is the small sample size problem. The other is the choice of basis functions (or independent components). Both problems make ICA classifier unstable and biased. To address the two problems, we propose an enhanced ICA algorithm using a cascaded ensemble learning scheme, named as Random Independent Subspace (RIS). A random resampling technique is used to generate a set of low dimensional feature subspaces in the original feature space and the whiten feature space, respectively. One classifier is constructed in each feature subspace. Then these classifiers are combined into an ensemble classifier using a final decision rule. Extensive experimentations performed on the FERET database suggest that the proposed method can improve the performance of ICA classifier.