Voting-averaged combination method for regressor ensemble

  • Authors:
  • Kun An;Jiang Meng

  • Affiliations:
  • School of Information and Communication Engineering, North University of China, Shanxi, China;School of Mechanical Engineering and Automatization, North University of China, Shanxi, China

  • Venue:
  • ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing
  • Year:
  • 2010

Quantified Score

Hi-index 0.01

Visualization

Abstract

A voting-averaged (VOA) method is presented to combine an ensemble for the regression tasks. VOA can select ensemble components dynamically using the hidden selectivity mechanism of voting, and hence VOA can be regarded as an improvement and extension of both voting and average methods. The experiment results of ten regression tasks show VOA and a representative selective average (SEA) method of GASEN (genetic algorithm-based selective ensemble), are of similar performances to each other, and both of better performance than simple average (SIA) in Bagging ensemble. SEA produces the ensemble subset in the using genetic optimization with validation datasets after the individuals are trained well; however, VOA combines a selective ensemble directly according to the cluster of the component outputs, not to determine ensemble subsets beforehand.