An improved method for bounding stationary measures of finite Markov processes

  • Authors:
  • Peter Buchholz

  • Affiliations:
  • Informatik IV, Universität Dortmund, D-44221 Dortmund, Germany

  • Venue:
  • Performance Evaluation - Performance 2005
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

A new method to compute bounds on stationary results of finite Markov processes in discrete or continuous time is introduced. The method extends previously published approaches using polyhedra of eigenvectors for stochastic matrices with a known lower and upper bound of their elements. Known techniques compute bounds for the elements of the stationary vector with respect to the lower bounds of the matrix elements and another set of bounds with respect to the upper bounds of matrix elements. The resulting bounds are usually not sharp, if lower and upper bounds for the elements are known. The new approach combines lower and upper bounds resulting in sharp bounds which are often much tighter than bounds computed using only one bounding value for the matrix elements.