Learning joint coordinated plans in multi-agent systems

  • Authors:
  • Walid E. Gomaa;Amani A. Saad;Mohamed A. Ismail

  • Affiliations:
  • Department of Computer Science, University of Maryland College Park, College Park, MD;Department of Computer Science, Alexandria University, Alexandria, Egypt;Department of Computer Science, Alexandria University, Alexandria, Egypt

  • Venue:
  • IEA/AIE'2003 Proceedings of the 16th international conference on Developments in applied artificial intelligence
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

One important class of problems in Multi-Agent Systems (MASs) is planning, that is constructing an optimal policy for each agent with the objective of reaching some terminal goal state. The key aspect of multi-agent planning is coordinating the actions of the individual agents. This coordination may be done through communication, learning, or conventions imposed at design time. In this paper we present a new taxonomy of MASs that is based on the notions of optimality and rationality. A framework that describes the interactions between the agents and their environment is given, along with a reinforcement learning-based algorithm (Q-learning) for learning a joint optimal plan. Finally, we give some experimental results on grid games that show the convergence of this algorithm.