Combination methods for ensembles of MF

  • Authors:

  • Joaquín Torres-Sospedra;Mercedes Fernández-Redondo;Carlos Hernández-Espinosa

  • Affiliations:

  • Universidad Jaume I. Dept. de Ingeniería y Ciencia de los Computadores, Castellon, Spain;Universidad Jaume I. Dept. de Ingeniería y Ciencia de los Computadores, Castellon, Spain;Universidad Jaume I. Dept. de Ingeniería y Ciencia de los Computadores, Castellon, Spain

  • Venue:
  • ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

As shown in the bibliography, training an ensemble of networks is an interesting way to improve the performance. The two key factors to design an ensemble are how to train the individual networks and how to combine the different outputs of the nets. In this paper, we focus on the combination methods. We study the performance of fourteen different combination methods for ensembles of the type "simple ensemble" (SE) and "decorrelated" (DECO). In the case of the "SE" and low number of networks in the ensemble, the method Zimmermann gets the best performance. When the number of networks is in the range of 9 and 20 the weighted average is the best alternative. Finally, in the case of the ensemble "DECO" the best performing method is averaging.