Automatic state abstraction from demonstration

  • Authors:
  • Luis C. Cobo;Peng Zang;Charles L. Isbell, Jr.;Andrea L. Thomaz

  • Affiliations:
  • College of Engineering, Georgia Tech., Atlanta, GA;College of Engineering, Georgia Tech., Atlanta, GA;College of Engineering, Georgia Tech., Atlanta, GA;College of Engineering, Georgia Tech., Atlanta, GA

  • Venue:
  • IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning from Demonstration (LfD) is a popular technique for building decision-making agents from human help. Traditional LfD methods use demonstrations as training examples for supervised learning, but complex tasks can require more examples than is practical to obtain. We present Abstraction from Demonstration (AfD), a novel form of LfD that uses demonstrations to infer state abstractions and reinforcement learning (RL) methods in those abstract state spaces to build a policy. Empirical results show that AfD is greater than an order of magnitude more sample efficient than just using demonstrations as training examples, and exponentially faster than RL alone.