Integrated learning for goal-driven autonomy

  • Authors:
  • Ulit Jaidee;Hé/ctor Muñ/oz-Avila;David W. Aha

  • Affiliations:
  • Department of Computer Science &/ Engineering/ Lehigh University/ Bethlehem, PA;Department of Computer Science &/ Engineering/ Lehigh University/ Bethlehem, PA;Navy Center for Applied Research in AI/ Naval Research Laboratory, Washington, DC

  • Venue:
  • IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Goal-driven autonomy (GDA) is a reflective model of goal reasoning that controls the focus of an agent's planning activities by dynamically resolving unexpected discrepancies in the world state, which frequently arise when solving tasks in complex environments. GDA agents have performed well on such tasks by integrating methods for discrepancy recognition, explanation, goal formulation, and goal management. However, they require substantial domain knowledge, including what constitutes a discrepancy and how to resolve it. We introduce LGDA, a learning algorithm for acquiring this knowledge, modeled as cases, that and integrates case-based reasoning and reinforcement learning methods. We assess its utility on tasks from a complex video game environment. We claim that, for these tasks, LGDA can significantly outperform its ablations. Our evaluation provides evidence to support this claim. LGDA exemplifies a feasible design methodology for deployable GDA agents.