Belief bisimulation for hidden markov models: logical characterisation and decision algorithm

  • Authors:
  • David N. Jansen;Flemming Nielson;Lijun Zhang

  • Affiliations:
  • Radboud Universiteit Nijmegen, The Netherlands;Technical University of Denmark, Denmark;Technical University of Denmark, Denmark

  • Venue:
  • NFM'12 Proceedings of the 4th international conference on NASA Formal Methods
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper establishes connections between logical equivalences and bisimulation relations for hidden Markov models (HMM). Both standard and belief state bisimulations are considered. We also present decision algorithms for the bisimilarities. For standard bisimilarity, an extension of the usual partition refinement algorithm is enough. Belief bisimilarity, being a relation on the continuous space of belief states, cannot be described directly. Instead, we show how to generate a linear equation system in time cubic in the number of states.