Learning with Continuous Experts Using Drifting Games

  • Authors:
  • Indraneel Mukherjee;Robert E. Schapire

  • Affiliations:
  • Department of Computer Science, Princeton University, Princeton, NJ 08540;Department of Computer Science, Princeton University, Princeton, NJ 08540

  • Venue:
  • ALT '08 Proceedings of the 19th international conference on Algorithmic Learning Theory
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider the problem of learning to predict as well as the best in a group of experts making continuous predictions. We assume the learning algorithm has prior knowledge of the maximum number of mistakes of the best expert. We propose a new master strategy that achieves the best known performance for online learning with continuous experts in the mistake bounded model. Our ideas are based on drifting games, a generalization of boosting and online learning algorithms. We also prove new lower bounds based on the drifting games framework which, though not as tight as previous bounds, have simpler proofs and do not require an enormous number of experts.