Dimensionality reduction based on ICA for regression problems

Authors:
Nojun Kwak;Chunghoon Kim;Hwangnam Kim
Affiliations:
Division of Electrical and Computer Engineering, Ajou University, San 5, Woncheon-dong, Yeongtong-gu, Suwon 443-749, Republic of Korea;Department of Computer Science, University of California, Santa Barbara, CA 93106, USA;School of Electrical Engineering, Korea University, Anam-dong, Seongbuk-Gu, Seoul 136-701, Republic of Korea
Venue:
Neurocomputing
Year:
2008

Citing 13
Cited 3

Introduction to statistical pattern recognition (2nd ed.)

Introduction to statistical pattern recognition (2nd ed.)
Elements of information theory

Elements of information theory
An information-maximization approach to blind separation and blind deconvolution

Neural Computation
Alignment by Maximization of Mutual Information

International Journal of Computer Vision
Enhancements to the data mining process

Enhancements to the data mining process
Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources

Neural Computation
Feature Extraction, Construction and Selection: A Data Mining Perspective

Feature Extraction, Construction and Selection: A Data Mining Perspective
Input Feature Selection by Mutual Information Based on Parzen Window

IEEE Transactions on Pattern Analysis and Machine Intelligence
Feature Extraction Based on ICA for Binary Classification Problems

IEEE Transactions on Knowledge and Data Engineering
KPCA Plus LDA: A Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition

Pattern Recognition Letters
Input feature selection for classification problems

IEEE Transactions on Neural Networks
Using mutual information for selecting features in supervised neural net learning

IEEE Transactions on Neural Networks

Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches

Decision Support Systems
Kernel discriminant analysis for regression problems

Pattern Recognition
Hybrid structure for robust dimensionality reduction

Neurocomputing

Quantified Score

Hi-index	0.01

Visualization

Abstract

In manipulating data such as in supervised learning, we often extract new features from the original input variables for the purpose of reducing the dimensions of input space and achieving better performances. In this paper, we show how standard algorithms for independent component analysis (ICA) can be extended to extract attributes for regression problems. The advantage is that general ICA algorithms become available to a task of dimensionality reduction for regression problems by maximizing the joint mutual information between target variable and new attributes. We applied the proposed method to a couple of real world regression problems as well as some artificial problems and compared the performances with those of other conventional methods. Experimental results show that the proposed method can efficiently reduce the dimension of input space without degrading the regression performance.