Introducing reordering algorithms to classic well-known ensembles to improve their performance

  • Authors:
  • Joaquín Torres-Sospedra;Carlos Hernández-Espinosa;Mercedes Fernández-Redondo

  • Affiliations:
  • Department of Computer Science and Engineering, Universitat Jaume I, Castellón, Spain;Department of Computer Science and Engineering, Universitat Jaume I, Castellón, Spain;Department of Computer Science and Engineering, Universitat Jaume I, Castellón, Spain

  • Venue:
  • ICONIP'11 Proceedings of the 18th international conference on Neural Information Processing - Volume Part II
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most of the well-known ensemble techniques use the same training algorithm and the same sequence of patterns from the learning set to adapt the trainable parameters (weights) of the neural networks in the ensemble. In this paper, we propose to replace the traditional training algorithm in which the sequence of patterns is kept unchanged during learning. With the new algorithms we want to add diversity to the ensemble and increase its accuracy by altering the sequence of patterns for each concrete network. Two new training set reordering strategies are proposed: Static reordering and Dynamic reordering. The new algorithms have been successfully tested with six different ensemble methods and the results show that reordering is a good alternative to traditional training.