Predictive Handling of Asynchronous Concept Drifts in Distributed Environments

  • Authors:
  • Hock Hee Ang;Vivekanand Gopalkrishnan;Indre Zliobaite;Mykola Pechenizkiy;Steven C. H. Hoi

  • Affiliations:
  • Nanyang Technological University, Singapore;Deloitte Analytics Institute Asia, Singapore;Bournemouth University, Poole;Eindhoven University of Technology, The Netherlands;Nanyang Technological University, Singapore

  • Venue:
  • IEEE Transactions on Knowledge and Data Engineering
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

In a distributed computing environment, peers collaboratively learn to classify concepts of interest from each other. When external changes happen and their concepts drift, the peers should adapt to avoid increase in misclassification errors. The problem of adaptation becomes more difficult when the changes are asynchronous, i.e., when peers experience drifts at different times. We address this problem by developing an ensemble approach, PINE, that combines reactive adaptation via drift detection, and proactive handling of upcoming changes via early warning and adaptation across the peers. With empirical study on simulated and real-world data sets, we show that PINE handles asynchronous concept drifts better and faster than current state-of-the-art approaches, which have been designed to work in less challenging environments. In addition, PINE is parameter insensitive and incurs less communication cost while achieving better accuracy.