Feature extraction based on subspace methods for regression problems

Authors:
Nojun Kwak;Jung-Won Lee
Affiliations:
Division of Electrical and Computer Engineering, Ajou University, San 5, Woncheon-dong, Yeongtong-gu, Suwon 443-749, Republic of Korea;Division of Electrical and Computer Engineering, Ajou University, San 5, Woncheon-dong, Yeongtong-gu, Suwon 443-749, Republic of Korea
Venue:
Neurocomputing
Year:
2010

Citing 15
Cited 2

An information-maximization approach to blind separation and blind deconvolution

Neural Computation
Data mining methods for knowledge discovery

Data mining methods for knowledge discovery
Feature Extraction Based on ICA for Binary Classification Problems

IEEE Transactions on Knowledge and Data Engineering
Linear Dimensionality Reduction via a Heteroscedastic Extension of LDA: The Chernoff Criterion

IEEE Transactions on Pattern Analysis and Machine Intelligence
KPCA Plus LDA: A Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition

Pattern Recognition Letters
Incremental Online Learning in High Dimensions

Neural Computation
Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning)

Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning)
Least squares linear discriminant analysis

Proceedings of the 24th international conference on Machine learning
Supervised tensor learning

Knowledge and Information Systems
Spectral regression: a unified subspace learning framework for content-based image retrieval

Proceedings of the 15th international conference on Multimedia
General Tensor Discriminant Analysis and Gabor Features for Gait Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Geometric Mean for Subspace Selection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Dimensionality reduction based on ICA for regression problems

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
Discriminant Locally Linear Embedding With High-Order Tensor Data

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Kernel discriminant analysis for regression problems

Pattern Recognition
Generalization of linear discriminant analysis using Lp-norm

Pattern Recognition Letters

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper, we propose a couple of new feature extraction methods for regression problems. The first one is closely related to the conventional principle component analysis (PCA) but unlike PCA, it incorporates target information in the optimization process and try to find a set of linear transforms that maximizes the distances between points with large differences in target values. On the other hand, the second one is a regressional version of linear discriminant analysis (LDA) which is very popular for classification problems. We have applied the proposed methods to several regression problems and compared the performance with the conventional feature extraction methods. The experimental results show that the proposed methods, especially the extension of LDA, perform well in many regression problems.