Using diversity to handle concept drift in on-line learning

  • Authors:
  • Fernanda L. Minku;Xin Yao

  • Affiliations:
  • Centre of Excellence for Research in Computational Intelligence and Applications, School of Computer Science, The University of Birmingham, Edgbaston, Birmingham, UK;Centre of Excellence for Research in Computational Intelligence and Applications, School of Computer Science, The University of Birmingham, Edgbaston, Birmingham, UK

  • Venue:
  • IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
  • Year:
  • 2009
  • Drift Severity Metric

    Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence

Quantified Score

Hi-index 0.00

Visualization

Abstract

A recent study of diversity using on-line ensembles of learning machines on the presence of concept drift shows that different diversity levels are required before and after a drift. Besides, studies from the dynamic optimisation problems area suggest that, if the best solution for a particular time step is adopted, it may lead to a future scenario in which low accuracy is obtained. Based on that, we propose in this paper a new on-line ensemble learning approach to handle concept drift, which uses ensembles containing different diversity levels. Even though a high diversity ensemble may have low accuracy while the concept is stable, it may present better accuracy after a drift. The proposed approach successfully chooses the ensemble to be used when a concept drift occurs and shows to obtain better accuracy than a system which adopts the strategy of learning a new classifier from scratch when a drift is detected (strategy adopted by many of the current approaches that explicitly use a drift detection method).