Interaction structure and dimensionality reduction in decentralized MDPs

  • Authors:
  • Martin Allen;Marek Petrik;Shlomo Zilberstein

  • Affiliations:
  • Computer Science Department, University of Massachusetts, Amherst, MA;Computer Science Department, University of Massachusetts, Amherst, MA;Computer Science Department, University of Massachusetts, Amherst, MA

  • Venue:
  • AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Decentralized Markov Decision Processes are a powerful general model of decentralized, cooperative multi-agent problem solving. The high complexity of the general problem leads to a focus on restricted models. While worst-case hardness of such reduced problems is often better, less is known about the actual difficulty of given instances. We show tight connections between the structure of agent interactions and the essential dimensionality of various problems. Bounds are placed on problem difficulty, given restrictions on the type and number of interactions between agents. These bounds arise from a bilinear programming formulation of the problem; from such a formulation, a more compact reduced form can be automatically generated, and the original problem rewritten to take advantage of the reduction.