A hybrid genetic algorithm for feature selection wrapper based on mutual information

Authors:
Jinjie Huang;Yunze Cai;Xiaoming Xu
Affiliations:
Department of Automation, Harbin University of Science and Technology, Xuefu Road 52, Harbin 150080, China and Department of Automation, Shanghai Jiao Tong University, Dongchuan Road 800, Shanghai ...;Department of Automation, Shanghai Jiao Tong University, Dongchuan Road 800, Shanghai 200240, China;Department of Automation, Shanghai Jiao Tong University, Dongchuan Road 800, Shanghai 200240, China and Shanghai Academy of Systems Science, University of Shanghai for Science and Technology, Jung ...
Venue:
Pattern Recognition Letters
Year:
2007

Citing 26
Cited 22

Elements of information theory

Elements of information theory
Wrappers for feature subset selection

Artificial Intelligence - Special issue on relevance
On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems

Theoretical Computer Science
Feature selection for ensembles

AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
Information-theoretic algorithm for feature selection

Pattern Recognition Letters
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
Feature Subset Selection Using a Genetic Algorithm

IEEE Intelligent Systems
Induction of Decision Trees

Machine Learning
An introduction to variable and feature selection

The Journal of Machine Learning Research
Variable selection using svm based criteria

The Journal of Machine Learning Research
Use of the zero norm with linear models and kernel methods

The Journal of Machine Learning Research
A Compact and Accurate Model for Classification

IEEE Transactions on Knowledge and Data Engineering
Consistency-based search in feature selection

Artificial Intelligence
Lower and Upper Bounds for Misclassification Probability Based on Renyi's Information

Journal of VLSI Signal Processing Systems
Fast Branch & Bound Algorithms for Optimal Feature Selection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Hybrid Genetic Algorithms for Feature Selection

IEEE Transactions on Pattern Analysis and Machine Intelligence
A feature selection technique for classificatory analysis

Pattern Recognition Letters
Improved use of continuous attributes in C4.5

Journal of Artificial Intelligence Research
Effective feature selection scheme using mutual information

Neurocomputing
Mutual information-based feature extraction on the time-frequencyplane

IEEE Transactions on Signal Processing
Enhancing genetic feature selection through restricted search and Walsh analysis

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Dimensionality reduction using genetic algorithms

IEEE Transactions on Evolutionary Computation
Probability of error, equivocation, and the Chernoff bound

IEEE Transactions on Information Theory
Input feature selection for classification problems

IEEE Transactions on Neural Networks
Feature selection in MLPs and SVMs based on maximum output information

IEEE Transactions on Neural Networks
Using mutual information for selecting features in supervised neural net learning

IEEE Transactions on Neural Networks

The application of mutual information-based feature selection and fuzzy LS-SVM-based classifier in motion classification

Computer Methods and Programs in Biomedicine
Feature Selection Using Mutual Information: An Experimental Study

PRICAI '08 Proceedings of the 10th Pacific Rim International Conference on Artificial Intelligence: Trends in Artificial Intelligence
Batch type local search-based adaptive neuro-fuzzy inference system (ANFIS) with self-feedbacks for time-series prediction

Neurocomputing
Feature selection with dynamic mutual information

Pattern Recognition
Involving New Local Search in Hybrid Genetic Algorithm for Feature Selection

ICONIP '09 Proceedings of the 16th International Conference on Neural Information Processing: Part II
Sequential multi-criteria feature selection algorithm based on agent genetic algorithm

Applied Intelligence
A new wrapper feature selection approach using neural network

Neurocomputing
Estimating redundancy information of selected features in multi-dimensional pattern classification

Pattern Recognition Letters
A hybrid feature selection scheme for unsupervised learning and its application in bearing fault diagnosis

Expert Systems with Applications: An International Journal
An efficient statistical feature selection approach for classification of gene expression data

Journal of Biomedical Informatics
mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification

Information Sciences: an International Journal
Feature selection for support vector machines with RBF kernel

Artificial Intelligence Review
A hybrid approach to feature subset selection for brain-computer interface design

IDEAL'11 Proceedings of the 12th international conference on Intelligent data engineering and automated learning
Feature subset selection wrapper based on mutual information and rough sets

Expert Systems with Applications: An International Journal
A new hybrid ant colony optimization algorithm for feature selection

Expert Systems with Applications: An International Journal
Feature evaluation and selection with cooperative game theory

Pattern Recognition
Attribute selection method based on a hybrid BPNN and PSO algorithms

Applied Soft Computing
A new local search based hybrid genetic algorithm for feature selection

Neurocomputing
An Evolutionary Algorithm Approach for Feature Generation from Sequence Data and Its Application to DNA Splice Site Prediction

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Feature selection based on cluster and variability analyses for ordinal multi-class classification problems

Knowledge-Based Systems
Supervised hybrid feature selection based on PSO and rough sets for medical diagnosis

Computer Methods and Programs in Biomedicine
Time-efficient estimation of conditional mutual information for variable selection in classification

Computational Statistics & Data Analysis

Quantified Score

Hi-index	0.10

Visualization

Abstract

In this study, a hybrid genetic algorithm is adopted to find a subset of features that are most relevant to the classification task. Two stages of optimization are involved. The outer optimization stage completes the global search for the best subset of features in a wrapper way, in which the mutual information between the predictive labels of a trained classifier and the true classes serves as the fitness function for the genetic algorithm. The inner optimization performs the local search in a filter manner, in which an improved estimation of the conditional mutual information acts as an independent measure for feature ranking taking account of not only the relevance of the candidate feature to the output classes but also the redundancy to the already-selected features. The inner and outer optimizations cooperate with each other and achieve the high global predictive accuracy as well as the high local search efficiency. Experimental results demonstrate both parsimonious feature selection and excellent classification accuracy of the method on a range of benchmark data sets.