Efficient reinforcement learning with relocatable action models

  • Authors:
  • Bethany R. Leffler;Michael L. Littman;Timothy Edmunds

  • Affiliations:
  • Department of Computer Science, Rutgers University, NJ;Department of Computer Science, Rutgers University, NJ;Department of Computer Science, Rutgers University, NJ

  • Venue:
  • AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1
  • Year:
  • 2007

Quantified Score

Hi-index 0.01

Visualization

Abstract

Realistic domains for learning possess regularities that make it possible to generalize experience across related states. This paper explores an environment-modeling framework that represents transitions as state-independent outcomes that are common to all states that share the same type. We analyze a set of novel learning problems that arise in this framework, providing lower and upper bounds. We single out one particular variant of practical interest and provide an efficient algorithm and experimental results in both simulated and robotic environments.