Using Bagging and Cross-Validation to improve ensembles based on penalty terms

  • Authors:
  • Joaquín Torres-Sospedra;Carlos Hernández-Espinosa;Mercedes Fernández-Redondo

  • Affiliations:
  • Department of Computer Science and Engineering, Universitat Jaume I, Castellón, Spain;Department of Computer Science and Engineering, Universitat Jaume I, Castellón, Spain;Department of Computer Science and Engineering, Universitat Jaume I, Castellón, Spain

  • Venue:
  • ICONIP'11 Proceedings of the 18th international conference on Neural Information Processing - Volume Part II
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Decorrelated and CELS are two ensembles that modify the learning procedure to increase the diversity among the networks of the ensemble. Although they provide good performance according to previous comparatives, they are not as well known as other alternatives, such as Bagging and Boosting, which modify the learning set in order to obtain classifiers with high performance. In this paper, two different procedures are introduced to Decorrelated and CELS in order to modify the learning set of each individual network and improve their accuracy. The results show that these two ensembles are improved by using the two proposed methodologies as specific set generators.