A feature selection method based on kernel canonical correlation analysis and the minimum Redundancy-Maximum Relevance filter method

Authors:
C. Okan Sakar;Olcay Kursun;Fikret Gurgen
Affiliations:
Department of Computer Engineering, Bahcesehir University, Istanbul, Turkey;Department of Computer Engineering, Istanbul University, Istanbul, Turkey;Department of Computer Engineering, Bogazici University, Istanbul, Turkey
Venue:
Expert Systems with Applications: An International Journal
Year:
2012

Citing 9
Cited 1

Input Feature Selection by Mutual Information Based on Parzen Window

IEEE Transactions on Pattern Analysis and Machine Intelligence
SINBAD: A neocortical mechanism for discovering environmental variables and regularities hidden in sensory input

Biological Cybernetics
Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy

IEEE Transactions on Pattern Analysis and Machine Intelligence
Canonical Correlation Analysis: An Overview with Application to Learning Methods

Neural Computation
Normalized mutual information feature selection

IEEE Transactions on Neural Networks
Information theoretic feature extraction for audio-visual speech recognition

IEEE Transactions on Signal Processing
Supervised feature selection by clustering using conditional mutual information-based distances

Pattern Recognition
Learning Bayesian networks with combination of MRMR criterion and EMI method

PAKDD'07 Proceedings of the 11th Pacific-Asia conference on Advances in knowledge discovery and data mining
On numerical optimization theory of infinite kernel learning

Journal of Global Optimization

Global geometric similarity scheme for feature selection in fault diagnosis

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	12.05

Visualization

Abstract

In this paper, we propose a feature selection method based on a recently popular minimum Redundancy-Maximum Relevance (mRMR) criterion, which we called Kernel Canonical Correlation Analysis basedmRMR (KCCAmRMR) based on the idea of finding the unique information, i.e. information that is distinct from the set of already selected variables, that a candidate variable possesses about the target variable. In simplest terms, for this purpose, we propose using correlated functions explored by KCCA instead of using the features themselves as inputs to mRMR. We demonstrate the usefulness of our method on both toy and benchmark datasets.