A note on the attractor-property of infinite-state Markov chains

  • Authors:
  • Christel Baier;Nathalie Bertrand;Philippe Schnoebelen

  • Affiliations:
  • Universität Bonn, Institut für Informatik I, Germany;Lab. Specification & Verification, CNRS UMR 8643 & ENS de Cachan, France;Lab. Specification & Verification, CNRS UMR 8643 & ENS de Cachan, France

  • Venue:
  • Information Processing Letters
  • Year:
  • 2006

Quantified Score

Hi-index 0.89

Visualization

Abstract

In the past 5 years, a series of verification algorithms has been proposed for infinite Markov chains that have a finite attractor, i.e., a set that will be visited infinitely often almost surely starting from any state. In this paper, we establish a sufficient criterion for the existence of an attractor. We show that if the states of a Markov chain can be given levels (positive integers) such that the expected next level for states at some level n0 is less than n-@D for some positive @D, then the states at level 0 constitute an attractor for the chain. As an application, we obtain a direct proof that some probabilistic channel systems combining message losses with duplication and insertion errors have a finite attractor.