The duality of state and observation in probabilistic transition systems

  • Authors:
  • Monica Dinculescu;Christopher Hundt;Prakash Panangaden;Joelle Pineau;Doina Precup

  • Affiliations:
  • Morgan Stanley, Montreal, Canada;Google Inc., Mountain View, California;McGill University, Montréal, Québec, Canada;McGill University, Montréal, Québec, Canada;McGill University, Montréal, Québec, Canada

  • Venue:
  • TbiLLC'11 Proceedings of the 9th international conference on Logic, Language, and Computation
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we consider the problem of representing and reasoning about systems, especially probabilistic systems, with hidden state. We consider transition systems where the state is not completely visible to an outside observer. Instead, there are observables that partly identify the state. We show that one can interchange the notions of state and observation and obtain what we call a dual system. In the case of deterministic systems, the double dual gives a minimal representation of the behaviour of the original system. We extend these ideas to probabilistic transition systems and to partially observable Markov decision processes (POMDPs).