Soft combination of neural classifiers: a comparative study
Pattern Recognition Letters
Decisions and evaluations by hierarchical aggregation of information
Fuzzy Sets and Systems
Improving the combination module with a neural network
ICIC'06 Proceedings of the 2006 international conference on Intelligent Computing - Volume Part I
| Hi-index | 0.00 |
As shown in the bibliography, training an ensemble of networks is an interesting way to improve the performance with respect to a single network. The two key factors to design an ensemble are how to train the individual networks and how to combine the different outputs of the networks to give a single output class. In this paper, we focus in the combination methods. We study the performance of fourteen different combination methods for ensembles of the type "simple ensemble" and "decorrelated". In the case of the "simple ensemble" and low number of networks in the ensemble, the method Zimmermann gets the best performance. When the number of networks is in the range of 9 and 20 the weighted average is the best alternative. Finally, in the case of the ensemble "decorrelated" the best performing method is averaging over a wide spectrum of the number of networks in the ensemble.