Top-level acceleration of adaptive algebraic multilevel methods for steady-state solution to Markov chains

  • Authors:

  • H. De Sterck;K. Miller;T. Manteuffel;G. Sanders

  • Affiliations:

  • Department of Applied Mathematics, University of Waterloo, Waterloo, Canada N2L 3G1;Department of Applied Mathematics, University of Waterloo, Waterloo, Canada N2L 3G1;Department of Applied Mathematics, University of Colorado, Boulder, USA 80309-0526;Department of Applied Mathematics, University of Colorado, Boulder, USA 80309-0526

  • Venue:
  • Advances in Computational Mathematics
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In many application areas, including information retrieval and networking systems, finding the steady-state distribution vector of an irreducible Markov chain is of interest and it is often difficult to compute efficiently. The steady-state vector is the solution to a nonsymmetric eigenproblem with known eigenvalue, B x驴=驴x, subject to probability constraints $ \Vert{\bf x}\Vert _1 = 1$ and x驴驴0, where B is column stochastic, that is, B驴驴驴O and 1 t B驴=驴1 t . Recently, scalable methods involving Smoothed Aggregation (SA) and Algebraic Multigrid (AMG) were proposed to solve such eigenvalue problems. These methods use multiplicative iterate updates versus the additive error corrections that are typically used in nonsingular linear solvers. This paper discusses an outer iteration that accelerates convergence of multiplicative update methods, similar in principle to a preconditioned flexible Krylov wrapper applied to an additive iteration for a nonsingular linear problem. The acceleration is performed by selecting a linear combination of old iterates to minimize a functional within the space of probability vectors. Two different implementations of this idea are considered and the effectiveness of these approaches is demonstrated with representative examples.