On-line learning: where are we so far?

  • Authors:
  • Antoine Cornuéjols

  • Affiliations:
  • AgroParisTech, UMR, Dept. MMIP, Paris cedex 05, France

  • Venue:
  • Ubiquitous knowledge discovery
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

After a long period of neglect, on-line learning is reemerging as an important topic in machine learning. On one hand, this is due to new applications involving data flows, the detection of, or adaption to, changing conditions and long-life learning. On the other hand, it is now apparent that the current statistical theory of learning, based on the independent and stationary distribution assumption, has reached its limits and must be completed or superseded to account for sequencing effects, and more generally, for the information carried by the evolution of the data generation process. This chapter first presents the current, still predominant paradigm. It then underlines the deviations to this framework introduced by new on-line learning settings, and the associated challenges that they raise both for devising novel algorithms and for developing a satisfactory new theory of learning. It concludes with a brief description of a new learning concept, called tracking, which may hint as to what could come off as algorithms and theoretical questions from looking anew to this allpervading situation: never to stop learning.