Structured apprenticeship learning

  • Authors:
  • Abdeslam Boularias;Oliver Krömer;Jan Peters

  • Affiliations:
  • Max Planck Institute for Intelligent Systems, Tübingen, Germany;Darmstadt University of Technology, Darmstadt, Germany;Max Planck Institute for Intelligent Systems, Tübingen, Germany, Darmstadt University of Technology, Darmstadt, Germany

  • Venue:
  • ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a graph-based algorithm for apprenticeship learning when the reward features are noisy. Previous apprenticeship learning techniques learn a reward function by using only local state features. This can be a limitation in practice, as often some features are misspecified or subject to measurement noise. Our graphical framework, inspired from the work on Markov Random Fields, allows to alleviate this problem by propagating information between states, and rewarding policies that choose similar actions in adjacent states. We demonstrate the advantage of the proposed approach on grid-world navigation problems, and on the problem of teaching a robot to grasp novel objects in simulation.