Integration of Bagging and Boosting with a New Reweighting Technique

  • Authors:
  • Yoshiaki YASUMURA;Naho KITANI;Kuniaki UEHARA

  • Affiliations:
  • Kobe University, Japan;Kobe University, Japan;Kobe University, Japan

  • Venue:
  • CIMCA '05 Proceedings of the International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce Vol-1 (CIMCA-IAWTIC'06) - Volume 01
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a novel ensemble learning method, IBB (Integration of Boosting and Bagging). This method creates initial classifiers by bagging, and then builds base classifiers by boosting using the previously created classifiers. IBB has two new techniques, a reweighting technique and data adaptation. The reweighting technique increases a weight of a sample which is misclassified by both the ensemble classifier and previously created base classifier. The data adaptation is realized by controlling the number of iteration in boosting. Experimental results using the datasets of UCI machine learning repository show that IBB resulted better accuracy than the other ensemble learning methods on several datasets and on average.