MultiBoosting: A Technique for Combining Boosting and Wagging

  • Authors:
  • Geoffrey I. Webb

  • Affiliations:
  • School of Computing and Mathematics, Deakin University, Geelong, Vic, 3217, Australia. webb@deakin.edu.au

  • Venue:
  • Machine Learning
  • Year:
  • 2000

Quantified Score

Hi-index 0.01

Visualization

Abstract

MultiBoosting is an extension to the highly successful AdaBoost technique for forming decision committees. MultiBoosting can be viewed as combining AdaBoost with wagging. It is able to harness both AdaBoost's high bias and variance reduction with wagging's superior variance reduction. Using C4.5 as the base learning algorithm, MultiBoosting is demonstrated to produce decision committees with lower error than either AdaBoost or wagging significantly more often than the reverse over a large representative cross-section of UCI data sets. It offers the further advantage over AdaBoost of suiting parallel execution.