A decision rule-based method for feature selection in predictive data mining

Authors:
Patricia E. N. Lutu;Andries P. Engelbrecht
Affiliations:
Department of Informatics, University of Pretoria, South Africa;Department of Computer Science, University of Pretoria, South Africa
Venue:
Expert Systems with Applications: An International Journal
Year:
2010

Citing 10
Cited 9

Heuristics: intelligent search strategies for computer problem solving

Heuristics: intelligent search strategies for computer problem solving
Wrappers for performance enhancement and oblivious decision graphs

Wrappers for performance enhancement and oblivious decision graphs
Selection of relevant features and examples in machine learning

Artificial Intelligence - Special issue on relevance
Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
An introduction to variable and feature selection

The Journal of Machine Learning Research
Dimensionality reduction via sparse support vector machines

The Journal of Machine Learning Research
Ranking a random feature for variable and feature selection

The Journal of Machine Learning Research
Benchmarking Attribute Selection Techniques for Discrete Class Data Mining

IEEE Transactions on Knowledge and Data Engineering
Differential prioritization in feature selection and classifier aggregation for multiclass microarray datasets

Data Mining and Knowledge Discovery
Average-case analysis of a nearest neighbor algorthim

IJCAI'93 Proceedings of the 13th international joint conference on Artifical intelligence - Volume 2

Multi-objective genetic algorithm evaluation in feature selection

EMO'11 Proceedings of the 6th international conference on Evolutionary multi-criterion optimization
Using confusion matrices and confusion graphs to design ensemble classification models from large datasets

DaWaK'11 Proceedings of the 13th international conference on Data warehousing and knowledge discovery
Empirical comparison of four classifier fusion strategies for positive-versus-negative ensembles

Proceedings of the South African Institute of Computer Scientists and Information Technologists Conference on Knowledge, Innovation and Leadership in a Diverse, Multidisciplinary Environment
Using OVA modeling to improve classification performance for large datasets

Expert Systems with Applications: An International Journal
Questionnaire- versus voice-based screening for laryngeal disorders

Expert Systems with Applications: An International Journal
Image feature selection based on ant colony optimization

AI'11 Proceedings of the 24th international conference on Advances in Artificial Intelligence
Efficient ant colony optimization for image feature selection

Signal Processing
Base Model Combination Algorithm for Resolving Tied Predictions for K-Nearest Neighbor OVA Ensemble Models

INFORMS Journal on Computing
Positive-versus-Negative Classification for Model Aggregation in Predictive Data Mining

INFORMS Journal on Computing

Quantified Score

Hi-index	12.05

Visualization

Abstract

Algorithms for feature selection in predictive data mining for classification problems attempt to select those features that are relevant, and are not redundant for the classification task. A relevant feature is defined as one which is highly correlated with the target function. One problem with the definition of feature relevance is that there is no universally accepted definition of what it means for a feature to be 'highly correlated with the target function or highly correlated with the other features'. A new feature selection algorithm which incorporates domain specific definitions of high, medium and low correlations is proposed in this paper. The proposed algorithm conducts a heuristic search for the most relevant features for the prediction task.