Recursive markov chains, stochastic grammars, and monotone systems of nonlinear equations

  • Authors:
  • Kousha Etessami;Mihalis Yannakakis

  • Affiliations:
  • School of Informatics, University of Edinburgh;Department of Computer Science, Columbia University

  • Venue:
  • STACS'05 Proceedings of the 22nd annual conference on Theoretical Aspects of Computer Science
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce and study Recursive Markov Chains (RMCs), which extend ordinary finite state Markov chains with the ability to invoke other Markov chains in a potentially recursive manner. They offer a natural abstract model for probabilistic programs with procedures, and are a probabilistic version of Recursive State Machines. RMCs generalize Stochastic Context-Free Grammars (SCFG) and multi-type Branching Processes, and are intimately related to Probabilistic Pushdown Systems. We focus here on termination and reachability analysis for RMCs. We present both positive and negative results for the general class of RMCs, as well as for important subclasses including SCFGs.