Empirical Evaluation of Optimized Stacking Configurations

  • Authors:
  • Agapito Ledezma;Ricardo Aler;Araceli Sanchis;Daniel Borrajo

  • Affiliations:
  • Universidad Carlos III de Madrid;Universidad Carlos III de Madrid;Universidad Carlos III de Madrid;Universidad Carlos III de Madrid

  • Venue:
  • ICTAI '04 Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Stacking is one of the most used techniques for combining classifiers and improve prediction accuracy. Early research in stacking showed that selecting the right classifiers, their parameters and the metaclassifiers was the main bottleneck for its use. Most of the research on this topic selects by hand the right combination of classifiers and their parameters. Instead of starting from these initial strong assumptions, our approach uses genetic algorithms to search for good stacking configurations. Since this can lead to overfitting, one of the goals of this paper is to evaluate empirically the overall efficiency of the approach. A second goal is to compare our approach with current best stacking building techniques. The results show that our approach finds stacking configurations that, in the worst case, perform as well as the best techniques, with the advantage of not having to set up manually the structure of the stacking system.