The diversity/accuracy dilemma: an empirical analysis in the context of heterogeneous ensembles

Authors:
Diogo F. De Oliveira;Anne M. P. Canuto;Marcilio C. P. De Souto
Affiliations:
Informatics and Applied Mathematics Department, Federal University of Rio Grande do Norte, Natal, RN, Brazil;Informatics and Applied Mathematics Department, Federal University of Rio Grande do Norte, Natal, RN, Brazil;Informatics and Applied Mathematics Department, Federal University of Rio Grande do Norte, Natal, RN, Brazil
Venue:
CEC'09 Proceedings of the Eleventh conference on Congress on Evolutionary Computation
Year:
2009

Citing 17
Cited 0

Adaptation in natural and artificial systems

Adaptation in natural and artificial systems
Combination of Multiple Classifiers Using Local Accuracy Estimates

IEEE Transactions on Pattern Analysis and Machine Intelligence
An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization

Machine Learning
Neural Network Ensembles

IEEE Transactions on Pattern Analysis and Machine Intelligence
Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy

Machine Learning
Combining Decision Trees and Neural Networks for Drug Discovery

EuroGP '02 Proceedings of the 5th European Conference on Genetic Programming
Combining Pattern Classifiers: Methods and Algorithms

Combining Pattern Classifiers: Methods and Algorithms
An analysis of diversity measures

Machine Learning
GNeurAge: An Evolutionary Agent-Based System for Classification Tasks

HIS '06 Proceedings of the Sixth International Conference on Hybrid Intelligent Systems
Comparison of classifier selection methods for improving committee performance

MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
A new ensemble diversity measure applied to thinning ensembles

MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
Pareto-Based Multiobjective Machine Learning: An Overview and Case Studies

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Evolutionary ensembles with negative correlation learning

IEEE Transactions on Evolutionary Computation
A fast and elitist multiobjective genetic algorithm: NSGA-II

IEEE Transactions on Evolutionary Computation
A multiagent genetic algorithm for global numerical optimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
An experimental bias-variance analysis of SVM ensembles based on resampling techniques

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A constructive algorithm for training cooperative neural network ensembles

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

Multi-classifier systems, also known as ensembles or committees, have been widely used to solve several classification problems, because they usually provide better performance than the individual classifiers. However, in order to build robust ensembles, it is necessary that the individual classifiers are as accurate as diverse among themselves - this is known as the diversity/accuracy dilemma. In this sense, some works analyzing the ensemble performance in context of this dilemma have been proposed. However, the majority of them address the homogenous structures of ensemble, i.e., ensembles composed only of the same type of classifiers. Thus, motivated by this limitation, this paper will perform an empirical investigation on the diversity/accuracy dilemma for heterogeneous ensembles. In order to do this, genetic algorithms will be used to guide the building of the ensemble systems.