Performance Analysis of Classifier Ensembles: Neural Networks Versus Nearest Neighbor Rule

Authors:
R. M. Valdovinos;J. S. Sánchez
Affiliations:
Lab. Reconocimiento de Patrones, Instituto Tecnológico de Toluca, Av. Tecnológico s/n, 52140 Metepec (México),;Dept. Llenguatges i Sistemes Informàtics, Universitat Jaume I, Av. Sos Baynat s/n, E-12071 Castelló de la Plana (Spain),
Venue:
IbPRIA '07 Proceedings of the 3rd Iberian conference on Pattern Recognition and Image Analysis, Part I
Year:
2007

Citing 12
Cited 0

Adaptive pattern recognition and neural networks

Adaptive pattern recognition and neural networks
Multilayer feedforward networks are universal approximators

Neural Networks
On the approximate realization of continuous mappings by neural networks

Neural Networks
Bagging predictors

Machine Learning
Voting over Multiple Condensed Nearest Neighbors

Artificial Intelligence Review - Special issue on lazy learning
Prototype selection for composite nearest neighbor classifiers

Prototype selection for composite nearest neighbor classifiers
Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy

Machine Learning
Combining Nearest Neighbor Classifiers Through Multiple Feature Subsets

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Ensemble of Linear Perceptrons with Confidence Level Output

HIS '04 Proceedings of the Fourth International Conference on Hybrid Intelligent Systems
Class-Dependant Resampling for Medical Applications

ICMLA '05 Proceedings of the Fourth International Conference on Machine Learning and Applications
Adaptive mixtures of local experts

Neural Computation
Negative correlation learning and the ambiguity family of ensemble methods

MCS'03 Proceedings of the 4th international conference on Multiple classifier systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

We here compare the performance (predictive accuracy and processing time) of different neural network ensembles with that of nearest neighbor classifier ensembles. Concerning the connectionist models, the multilayer perceptron and the modular neural network are employed. Experiments on several real-problem data sets demonstrate a certain superiority of the nearest-neighbor-based schemes, in terms of both accuracy and computing time. When comparing the neural network ensembles, one can observe a better behavior of the multilayer perceptron than that of the modular networks.