Rounding errors in certain algorithms involving Markov chains

  • Authors:
  • Winfried K. Grassmann

  • Affiliations:
  • Univ. of Saskatchewan

  • Venue:
  • ACM Transactions on Mathematical Software (TOMS)
  • Year:
  • 1993

Quantified Score

Hi-index 0.00

Visualization

Abstract

A number of algorithms involving Markov chains contain no subtractions. This property makes the analysis of rounding errors particularly simple. To show this, some principles for analyzing the propagation and generation of rounding errors in algorithms containing no subtraction are discussed first. These principles are then applied in the context of a simple recursive algorithm involving the transient solution of discrete-time Markov chains, Jensen's algorithm, and state reduction. Jensen's algorithm, also known as randomization or uniformization, is an algorithm for finding transient solutions of continuous-time Markov chains. State reduction is a method for finding equilibrium probabilities for discrete-time or continuous-time Markov chains.