Observing continuous-time MDPs by 1-clock timed automata

  • Authors:
  • Taolue Chen;Tingting Han;Joost-Pieter Katoen;Alexandru Mereacre

  • Affiliations:
  • Department of Computer Science, University of Oxford, United Kingdom;Department of Computer Science, University of Oxford, United Kingdom;Software Modeling and Verification Group, RWTH Aachen University, Germany;Department of Computer Science, University of Oxford, United Kingdom

  • Venue:
  • RP'11 Proceedings of the 5th international conference on Reachability problems
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper considers the verification of continuous-time Markov decision process (CTMDPs) against single-clock deterministic timed automata (DTA) specifications. The central issue is to compute the maximum probability of the set of timed paths of a CTMDP C that are accepted by a DTA A. We show that this problem can be reduced to a linear programming problem whose coefficients are maximum timed reachability probabilities in a set of CTMDPs, which are obtained via a graph decomposition of the product of the CTMDP C and the region graph of the DTA A.