Multiagent POMDPs with asynchronous execution

  • Authors:

  • João V. Messias;Matthijs T.J. Spaan;Pedro U. Lima

  • Affiliations:

  • Instituto Superior Técnico - Universidade Técnica de Lisboa, Lisbon, Portugal;Delft University of Technology, Delft, Netherlands;Instituto Superior Técnico - Universidade Técnica de Lisboa, Lisbon, Portugal

  • Venue:
  • Proceedings of the 2013 international conference on Autonomous agents and multi-agent systems
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Multiagent POMDP (MPOMDP) framework provides well-known methods to model and solve fully communicative multiagent problems. However, the size of these models grows exponentially in the number of agents, and agents are required to act in synchrony. We show how these problems can be mitigated through an event-driven, asynchronous formulation of the MPOMDP dynamics. We can prove that the optimal value function in our framework is piecewise linear and convex, allowing us to extend a standard point-based solver to the event-driven setting. We also show how belief states can be updated at run-time in asynchronous domains. Our results show that asynchronous models scale better to larger domains than synchronous analogues, while retaining solution quality.