A hybrid architecture combining reactive plan execution and reactive learning

  • Authors:
  • Samin Karim;Liz Sonenberg;Ah-Hwee Tan

  • Affiliations:
  • Department of Information Systems, University of Melbourne, Melbourne, Australia;Department of Information Systems, University of Melbourne, Melbourne, Australia;School of Computer Engineering, Nanyang Technological University, Singapore

  • Venue:
  • PRICAI'06 Proceedings of the 9th Pacific Rim international conference on Artificial intelligence
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Developing software agents has been complicated by the problem of how knowledge should be represented and used. Many researchers have identified that agents need not require the use of complex representations, but in many cases suffice to use "the world" as their representation. However, the problem of introspection, both by the agents themselves and by (human) domain experts, requires a knowledge representation with a higher level of abstraction that is more 'understandable'. Learning and adaptation in agents has traditionally required knowledge to be represented at an arbitrary, low-level of abstraction. We seek to create an agent that has the capability of learning as well as utilising knowledge represented at a higher level of abstraction. We firstly explore a reactive learner (Falcon) and reactive plan execution engine based on BDI (JACK) through experiments and analysis. We then describe an architecture we have developed that combines the BDI framework to the low-level reinforcement learner and present promising results from experiments using our minefield navigation domain.