Estimating optimal feature subsets using efficient estimation of high-dimensional mutual information

Authors:
T. W.S. Chow;D. Huang
Affiliations:
City Univ. of Hong Kong, China;-
Venue:
IEEE Transactions on Neural Networks
Year:
2005

Citing 0
Cited 23

Input Variable Selection: Mutual Information and Linear Mixing Measures

IEEE Transactions on Knowledge and Data Engineering
Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Pattern Recognition
Non-linear variable selection for artificial neural networks using partial mutual information

Environmental Modelling & Software
Enhanced feature selection models using gradient-based and point injection techniques

Neurocomputing
A minimax mutual information scheme for supervised feature extraction and its application to EEG-based brain-computer interfacing

EURASIP Journal on Advances in Signal Processing
An efficient gene selection algorithm based on mutual information

Neurocomputing
Computational accounting in determining Chart of Accounts using nominal data analysis and concept of entropy

Expert Systems with Applications: An International Journal
Design of input vector for day-ahead price forecasting of electricity markets

Expert Systems with Applications: An International Journal
Normalized mutual information feature selection

IEEE Transactions on Neural Networks
Object detection using spatial histogram features

Image and Vision Computing
Energy Supervised Relevance Neural Gas for Feature Ranking

Neural Processing Letters
Informational energy kernel for LVQ

ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
A filter based feature selection approach using lempel ziv complexity

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification

Information Sciences: an International Journal
Investigating a novel GA-based feature selection method using improved KNN classifiers

International Journal of Information and Communication Technology
A new hybrid ant colony optimization algorithm for feature selection

Expert Systems with Applications: An International Journal
Input variable selection for feature extraction in classification problems

Signal Processing
An excellent feature selection model using gradient-based and point injection techniques

ICONIP'06 Proceedings of the 13th international conference on Neural Information Processing - Volume Part II
Feature selection for microarray data analysis using mutual information and rough set theory

ICIC'06 Proceedings of the 2006 international conference on Computational Intelligence and Bioinformatics - Volume Part III
Dimensionality Reduction with Unsupervised Feature Selection and Applying Non-Euclidean Norms for Classification Accuracy

International Journal of Data Warehousing and Mining
Assessment of geometric features for individual identification and verification in biometric hand systems

Expert Systems with Applications: An International Journal
Improving the performance of P300-based brain-computer interface through subspace-based filtering

Neurocomputing
A novel feature selection method and its application

Journal of Intelligent Information Systems

Quantified Score

Hi-index	0.01

Visualization

Abstract

A novel feature selection method using the concept of mutual information (MI) is proposed in this paper. In all MI based feature selection methods, effective and efficient estimation of high-dimensional MI is crucial. In this paper, a pruned Parzen window estimator and the quadratic mutual information (QMI) are combined to address this problem. The results show that the proposed approach can estimate the MI in an effective and efficient way. With this contribution, a novel feature selection method is developed to identify the salient features one by one. Also, the appropriate feature subsets for classification can be reliably estimated. The proposed methodology is thoroughly tested in four different classification applications in which the number of features ranged from less than 10 to over 15000. The presented results are very promising and corroborate the contribution of the proposed feature selection methodology.