Model checking algorithms for CTMDPs

  • Authors:
  • Peter Buchholz;Ernst Moritz Hahn;Holger Hermanns;Lijun Zhang

  • Affiliations:
  • Technical University of Dortmund, Computer Science, Germany;Saarland University, Computer Science, Germany;Saarland University, Computer Science, Germany;Technical University of Denmark, DTU Informatics, Denmark

  • Venue:
  • CAV'11 Proceedings of the 23rd international conference on Computer aided verification
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Continuous Stochastic Logic (CSL) can be interpreted over continuoustime Markov decision processes (CTMDPs) to specify quantitative properties of stochastic systems that allow some external control. Model checking CSL formulae over CTMDPs requires then the computation of optimal control strategies to prove or disprove a formula. The paper presents a conservative extension of CSL over CTMDPs--with rewards--and exploits established results for CTMDPs for model checking CSL. A new numerical approach based on uniformization is devised to compute time bounded reachability results for time dependent control strategies. Experimental evidence is given showing the efficiency of the approach.