Goal-Directed online learning of predictive models

  • Authors:
  • Sylvie C. W. Ong;Yuri Grinberg;Joelle Pineau

  • Affiliations:
  • School of Computer Science, McGill University, Montreal, Canada;School of Computer Science, McGill University, Montreal, Canada;School of Computer Science, McGill University, Montreal, Canada

  • Venue:
  • EWRL'11 Proceedings of the 9th European conference on Recent Advances in Reinforcement Learning
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an algorithmic approach for integrated learning and planning in predictive representations. The approach extends earlier work on predictive state representations to the case of online exploration, by allowing exploration of the domain to proceed in a goal-directed fashion and thus be more efficient. Our algorithm interleaves online learning of the models, with estimation of the value function. The framework is applicable to a variety of important learning problems, including scenarios such as apprenticeship learning, model customization, and decision-making in non-stationary domains.