Handling ambiguous effects in action learning

  • Authors:
  • Boris Lesner;Bruno Zanuttini

  • Affiliations:
  • GREYC, Université de Caen Basse-Normandie, CNRS UMR 6072, ENSICAEN, France;GREYC, Université de Caen Basse-Normandie, CNRS UMR 6072, ENSICAEN, France

  • Venue:
  • EWRL'11 Proceedings of the 9th European conference on Recent Advances in Reinforcement Learning
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We study the problem of learning stochastic actions in propositional, factored environments, and precisely the problem of identifying STRIPS-like effects from transitions in which they are ambiguous. We give an unbiased, maximum likelihood approach, and show that maximally likely actions can be computed efficiently from observations. We also discuss how this study can be used to extend an RL approach for actions with independent effects to one for actions with correlated effects.