Bisimulation and logical preservation for continuous-time markov decision processes

  • Authors:
  • Martin R. Neuhäußer;Joost-Pieter Katoen

  • Affiliations:
  • RWTH Aachen University, Germany and University of Twente, The Netherlands;RWTH Aachen University, Germany and University of Twente, The Netherlands

  • Venue:
  • CONCUR'07 Proceedings of the 18th international conference on Concurrency Theory
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper introduces strong bisimulation for continuoustime Markov decision processes (CTMDPs), a stochastic model which allows for a nondeterministic choice between exponential distributions, and shows that bisimulation preserves the validity of CSL. To that end, we interpret the semantics of CSL--a stochastic variant of CTL for continuous-time Markov chains--on CTMDPs and show its measuretheoretic soundness. The main challenge faced in this paper is the proof of logical preservation that is substantially based on measure theory.