Efficient Transient Analysis of Markovian Models Using a Block Reduction Approach

  • Authors:
  • Edmundo de Souza e Silva;Rosa M. M. Leão;Raymond Marie

  • Affiliations:
  • Systems Engineering and Computer Science Department, Federal University of Rio de Janeiro, Graduate School and Research in Engineering, Rio de Janeiro, RJ 21945-970, Brazil;Systems Engineering and Computer Science Department, Federal University of Rio de Janeiro, Graduate School and Research in Engineering, Rio de Janeiro, RJ 21945-970, Brazil;Institut de Recherche en Informatique et Systèmes Aléatoires, University of Rennes I, INRIA, Campus Universitaire de Beaulieu, 35042 Rennes Cedex, France

  • Venue:
  • INFORMS Journal on Computing
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

One of the most widely used techniques to obtain transient measures is the uniformization method. However, although uniformization has many advantages, the computational cost required to calculate transient probabilities is very large for stiff models. We study efficient solutions that can be applied to an approximate method developed for calculating transient state probabilities of Markov models and cumulative expected reward measures over a finite interval. Our work is based on a method that approximates the state probabilities at time t by the state probabilities calculated at a random time with Erlangian distribution. The original method requires an inversion of a matrix obtained from the state transition rate matrix that destroys special structures such as sparseness and banded matrices. This precludes the use of the technique for large models. In our work we propose efficient solutions that can take advantage of special structures. Finally, we present examples that show that the proposed technique is computationally very efficient for stiff models when compared with uniformization.