Improving adaptive boosting with k-cross-fold validation

  • Authors:
  • Joaquín Torres-Sospedra;Carlos Hernández-Espinosa;Mercedes Fernández-Redondo

  • Affiliations:
  • Departamento de Ingenieria y Ciencia de los Computadores, Universitat Jaume I, Castellon, Spain;Departamento de Ingenieria y Ciencia de los Computadores, Universitat Jaume I, Castellon, Spain;Departamento de Ingenieria y Ciencia de los Computadores, Universitat Jaume I, Castellon, Spain

  • Venue:
  • ICIC'06 Proceedings of the 2006 international conference on Intelligent Computing - Volume Part I
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

As seen in the bibliography, Adaptive Boosting (Adaboost) is one of the most known methods to increase the performance of an ensemble of neural networks. We introduce a new method based on Adaboost where we have applied Cross-Validation to increase the diversity of the ensemble. We have used Cross-Validation over the whole learning set to generate an specific training set and validation set for each network of the committee. We have tested Adaboost and Crossboost with seven databases from the UCI repository. We have used the mean percentage of error reduction and the mean increase of performance to compare both methods, the results show that Crossboost performs better.