Ensemble learning with local diversity

  • Authors:
  • Ricardo Ñanculef;Carlos Valle;Héctor Allende;Claudio Moraga

  • Affiliations:
  • Departamento de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile;Departamento de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile;Departamento de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile;European Centre for Soft Computing, Mieres, Asturias, Spain

  • Venue:
  • ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The concept of Diversity is now recognized as a key characteristic of successful ensembles of predictors. In this paper we investigate an algorithm to generate diversity locally in regression ensembles of neural networks, which is based on the idea of imposing a neighborhood relation over the set of learners. In this algorithm each predictor iteratively improves its state considering only information about the performance of the neighbors to generate a sort of local negative correlation. We will assess our technique on two real data sets and compare this with Negative Correlation Learning, an effective technique to get diverse ensembles. We will demonstrate that the local approach exhibits better or comparable results than this global one.