Transform-Domain solutions of poisson's equation with applications to the asymptotic variance

  • Authors:

  • Koen De Turck;Sofian De Clercq;Sabine Wittevrongel;Herwig Bruneel;Dieter Fiems

  • Affiliations:

  • Department of Telecommunications and Information Processing, Ghent University, Gent, Belgium;Department of Telecommunications and Information Processing, Ghent University, Gent, Belgium;Department of Telecommunications and Information Processing, Ghent University, Gent, Belgium;Department of Telecommunications and Information Processing, Ghent University, Gent, Belgium;Department of Telecommunications and Information Processing, Ghent University, Gent, Belgium

  • Venue:
  • ASMTA'12 Proceedings of the 19th international conference on Analytical and Stochastic Modeling Techniques and Applications
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recent years have seen a considerable increase of attention devoted to Poisson's equation for Markov chains, which now has attained a central place in Markov chain theory, due to the extensive list of areas where Poisson's equation pops up: perturbation analysis, Markov decision processes, limit theorems of Markov chains, etc. all find natural expression when viewed from the vantage point of Poisson's equation. We describe how the use of generating functions helps solve Poisson's equation for different types of structured Markov chains and for driving functions, and point out some applications. In particular, we solve Poisson's equation in the transform domain for skip-free Markov chains and Markov chains with linear displacement. Closed-form solutions are obtained for a class of driving functions encompassing polynomial functions and functions with finite support.