Genetic algorithm-based feature set partitioning for classification problems

Authors:
Lior Rokach
Affiliations:
Department of Information System Engineering, Ben-Gurion University of the Negev, Israel
Venue:
Pattern Recognition
Year:
2008

Citing 29
Cited 14

Introduction to statistical pattern recognition (2nd ed.)

Introduction to statistical pattern recognition (2nd ed.)
Neural networks and the bias/variance dilemma

Neural Computation
C4.5: programs for machine learning

C4.5: programs for machine learning
Learning Boolean concepts in the presence of many irrelevant features

Artificial Intelligence
Learning Boolean formulas

Journal of the ACM (JACM)
On the practical applicability of VC dimension bounds

Neural Computation
Bagging predictors

Machine Learning
On the Accuracy of Meta-learning for Scalable Data Mining

Journal of Intelligent Information Systems
The Random Subspace Method for Constructing Decision Forests

IEEE Transactions on Pattern Analysis and Machine Intelligence
Feature selection for ensembles

AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
Efficient GA Based Techniques for Classification

Applied Intelligence
A Survey of Methods for Scaling Up Inductive Algorithms

Data Mining and Knowledge Discovery
Combining Multiple K-Nearest Neighbor Classifiers for Text Classification by Reducts

DS '02 Proceedings of the 5th International Conference on Discovery Science
Generalization Bounds for Decision Trees

COLT '00 Proceedings of the Thirteenth Annual Conference on Computational Learning Theory
On the complexity of computing and learning with multiplicative neural networks

Neural Computation
Ensemble Feature election with the Simple Bayesian Classification in Medical Diagnostics

CBMS '02 Proceedings of the 15th IEEE Symposium on Computer-Based Medical Systems (CBMS'02)
A Compact and Accurate Model for Classification

IEEE Transactions on Knowledge and Data Engineering
Learning Ensembles from Bites: A Scalable and Accurate Approach

The Journal of Machine Learning Research
Genetic wrappers for feature selection in decision tree induction and variable ordering in Bayesian network structure learning

Information Sciences: an International Journal - Special issue: Soft computing data mining
Multiknowledge for decision making

Knowledge and Information Systems
Feature selection algorithms for the generation of multiple classifier systems and their application to handwritten word recognition

Pattern Recognition Letters
Decomposition methodology for classification tasks: a meta decomposer framework

Pattern Analysis & Applications
Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing)

Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing)
Feature set decomposition for decision trees

Intelligent Data Analysis
Statistical Comparisons of Classifiers over Multiple Data Sets

The Journal of Machine Learning Research
Induction of selective Bayesian classifiers

UAI'94 Proceedings of the Tenth international conference on Uncertainty in artificial intelligence
Constructing rough decision forests

RSFDGrC'05 Proceedings of the 10th international conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing - Volume Part II
Nonparametric multivariate density estimation: a comparative study

IEEE Transactions on Signal Processing
Supervised classification in high-dimensional space: geometrical, statistical, and asymptotical properties of multivariate data

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews

Feature selection in bankruptcy prediction

Knowledge-Based Systems
Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography

Computational Statistics & Data Analysis
Ensemble-based classifiers

Artificial Intelligence Review
IFS-CoCo: Instance and feature selection based on cooperative coevolution with nearest neighbor rule

Pattern Recognition
Creating ensembles of classifiers via fuzzy clustering and deflection

Fuzzy Sets and Systems
An improved genetic algorithm for optimal feature subset selection from multi-character feature set

Expert Systems with Applications: An International Journal
A fuzzy-based data transformation for feature extraction to increase classification performance with small medical data sets

Artificial Intelligence in Medicine
mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification

Information Sciences: an International Journal
Selective voting in convex-hull ensembles improves classification accuracy

Artificial Intelligence in Medicine
How to reduce dimension while improving performance

HAIS'12 Proceedings of the 7th international conference on Hybrid Artificial Intelligent Systems - Volume Part I
An efficient ensemble classification method based on novel classifier selection technique

Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics
Discrete Artificial Bee Colony Optimization Algorithm for Financial Classification Problems

International Journal of Applied Metaheuristic Computing
GA-TVRC-Het: genetic algorithm enhanced time varying relational classifier for evolving heterogeneous networks

Data Mining and Knowledge Discovery
Dynamic facial expression analysis based on extended spatio-temporal histogram of oriented gradients

International Journal of Biometrics

Quantified Score

Hi-index	0.01

Visualization

Abstract

Feature set partitioning generalizes the task of feature selection by partitioning the feature set into subsets of features that are collectively useful, rather than by finding a single useful subset of features. This paper presents a novel feature set partitioning approach that is based on a genetic algorithm. As part of this new approach a new encoding schema is also proposed and its properties are discussed. We examine the effectiveness of using a Vapnik-Chervonenkis dimension bound for evaluating the fitness function of multiple, oblivious tree classifiers. The new algorithm was tested on various datasets and the results indicate the superiority of the proposed algorithm to other methods.