Aggregation Algorithms for Neural Network Ensemble Construction

  • Authors:
  • P. M. Granitto;P. F. Verdes;H. D. Navone;H. A. Ceccatto

  • Affiliations:
  • -;-;-;-

  • Venue:
  • SBRN '02 Proceedings of the VII Brazilian Symposium on Neural Networks (SBRN'02)
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

How to generate and aggregate base learners to haveoptimal ensemble generalization capabilities is animportant questions in building compositeregression/classification machines. We present here anevaluation of several algorithms for artificial neuralnetworks aggregation in the regression settings, includingnew proposals and comparing them with standardmethods in the literature. We also discuss a potentialproblem with sequential algorithms: the non-frequent butdamaging selection through their heuristics ofparticularly bad ensemble members. We show that onecan cope with this problem by allowing individualweighting of aggregate members. Our algorithms andtheir weighted modifications are favorably tested againstother methods in the literature, producing a performanceimprovement on the standard statistical databases used asbenchmarks.