Feature selection using dynamic weights for classification

Authors:
Xin Sun;Yanheng Liu;Mantao Xu;Huiling Chen;Jiawei Han;Kunhao Wang
Affiliations:
College of Computer Science and Technology, Jilin University, Changchun, Jilin 130012, China and School of Computing, University of Eastern Finland, Joensuu FIN-80101, Finland;College of Computer Science and Technology, Jilin University, Changchun, Jilin 130012, China and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin Un ...;School of Computing, University of Eastern Finland, Joensuu FIN-80101, Finland and School of Electrical Engineering, Shanghai Dianji University, Shanghai 200240, China;College of Computer Science and Technology, Jilin University, Changchun, Jilin 130012, China;College of Computer Science and Technology, Jilin University, Changchun, Jilin 130012, China;College of Computer Science and Technology, Jilin University, Changchun, Jilin 130012, China
Venue:
Knowledge-Based Systems
Year:
2013

Citing 39
Cited 1

A practical approach to feature selection

ML92 Proceedings of the ninth international workshop on Machine learning
Statistical Pattern Recognition: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
Input Feature Selection by Mutual Information Based on Parzen Window

IEEE Transactions on Pattern Analysis and Machine Intelligence
Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
A Comparison of Several Approaches to Missing Attribute Values in Data Mining

RSCTC '00 Revised Papers from the Second International Conference on Rough Sets and Current Trends in Computing
Feature Selection Algorithms: A Survey and Experimental Evaluation

ICDM '02 Proceedings of the 2002 IEEE International Conference on Data Mining
Minimum Redundancy Feature Selection from Microarray Gene Expression Data

CSB '03 Proceedings of the IEEE Computer Society Conference on Bioinformatics
Theoretical and Empirical Analysis of ReliefF and RReliefF

Machine Learning
An introduction to variable and feature selection

The Journal of Machine Learning Research
Consistency-based search in feature selection

Artificial Intelligence
Fast Branch & Bound Algorithms for Optimal Feature Selection

IEEE Transactions on Pattern Analysis and Machine Intelligence
A selective sampling approach to active feature selection

Artificial Intelligence
Efficient Feature Selection via Analysis of Relevance and Redundancy

The Journal of Machine Learning Research
Fast Binary Feature Selection with Conditional Mutual Information

The Journal of Machine Learning Research
Toward Integrating Feature Selection Algorithms for Classification and Clustering

IEEE Transactions on Knowledge and Data Engineering
Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy

IEEE Transactions on Pattern Analysis and Machine Intelligence
Feature Extraction Using Information-Theoretic Learning

IEEE Transactions on Pattern Analysis and Machine Intelligence
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Top 10 algorithms in data mining

Knowledge and Information Systems
Mining co-regulated gene profiles for the detection of functional associations in gene expression data

Bioinformatics
Performance of feature-selection methods in the classification of high-dimension data

Pattern Recognition
Feature selection with dynamic mutual information

Pattern Recognition
A filter model for feature subset selection based on genetic algorithm

Knowledge-Based Systems
Implement web learning environment based on data mining

Knowledge-Based Systems
2009 Special Issue: Boosting feature selection for Neural Network based regression

Neural Networks
Information-theoretic feature selection for functional data classification

Neurocomputing
Normalized mutual information feature selection

IEEE Transactions on Neural Networks
Information gain and divergence-based feature selection for machine learning-based text categorization

Information Processing and Management: an International Journal - Special issue: Formal methods for information retrieval
Effective feature selection scheme using mutual information

Neurocomputing
Conditional mutual information based feature selection for classification task

CIARP'07 Proceedings of the Congress on pattern recognition 12th Iberoamerican conference on Progress in pattern recognition, image analysis and applications
Information distance based fitness and diversity metrics

Proceedings of the 12th annual conference companion on Genetic and evolutionary computation
A novel hybrid feature selection via Symmetrical Uncertainty ranking based local memetic search algorithm

Knowledge-Based Systems
A rough set approach to feature selection based on power set tree

Knowledge-Based Systems
Fuzzy rough set based attribute reduction for information systems with fuzzy decisions

Knowledge-Based Systems
Fast wrapper feature subset selection in high-dimensional datasets by means of filter re-ranking

Knowledge-Based Systems
Feature evaluation and selection with cooperative game theory

Pattern Recognition
Using mutual information for selecting features in supervised neural net learning

IEEE Transactions on Neural Networks
Using cooperative game theory to optimize the feature selection problem

Neurocomputing

Bi-objective feature selection for discriminant analysis in two-class classification

Knowledge-Based Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Feature selection aims at finding a feature subset that has the most discriminative information from the original feature set. In this paper, we firstly present a new scheme for feature relevance, interdependence and redundancy analysis using information theoretic criteria. Then, a dynamic weighting-based feature selection algorithm is proposed, which not only selects the most relevant features and eliminates redundant features, but also tries to retain useful intrinsic groups of interdependent features. The primary characteristic of the method is that the feature is weighted according to its interaction with the selected features. And the weight of features will be dynamically updated after each candidate feature has been selected. To verify the effectiveness of our method, experimental comparisons on six UCI data sets and four gene microarray datasets are carried out using three typical classifiers. The results indicate that our proposed method achieves promising improvement on feature selection and classification accuracy.