Local negative correlation with resampling

  • Authors:
  • Ricardo Ñanculef;Carlos Valle;Héctor Allende;Claudio Moraga

  • Affiliations:
  • Departamento de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile;Departamento de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile;Departamento de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile;European Centre for Soft Computing, Mieres, Asturias, Spain

  • Venue:
  • IDEAL'06 Proceedings of the 7th international conference on Intelligent Data Engineering and Automated Learning
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper deals with a learning algorithm which combines two well known methods to generate ensemble diversity – error negative correlation and resampling. In this algorithm, a set of learners iteratively and synchronously improve their state considering information about the performance of a fixed number of other learners in the ensemble, to generate a sort of local negative correlation. Resampling allows the base algorithm to control the impact of highly influential data points which in turns can improve its generalization error. The resulting algorithm can be viewed as a generalization of bagging, where each learner no longer is independent but can be locally coupled with other learners. We will demonstrate our technique on two real data sets using neural networks ensembles.