Quasi deterministic POMDPs and DecPOMDPs

  • Authors:
  • Camille Besse;Brahim Chaib-draa

  • Affiliations:
  • Laval University, Quebec (Qc), Canada;Laval University, Quebec (Qc), Canada

  • Venue:
  • Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we study a particular subclass of partially observable models, called quasi-deterministic partially observable Markov decision processes (qDET-POMDPs), characterized by deterministic transitions and stochastic observations. While this framework does not model the same general problems as POMDPs, it still captures a number of interesting and challenging problems and have, in some cases, interesting properties. By studying the observability available in this subclass, we suggest that qDET-POMDPs may fall many steps in the complexity hierarchy. An extension of this framework to the decentralized case also reveals a subclass of numerous problems that can be approximated in polynomial space.