An information-theoretic framework to aggregate a Markov chain

  • Authors:
  • Kun Deng;Yu Sun;Prashant G. Mehta;Sean P. Meyn

  • Affiliations:
  • Coordinated Science Laboratory, Unirversity of Illinois at Urbana-Champaign, Urbana, IL;Coordinated Science Laboratory, Unirversity of Illinois at Urbana-Champaign, Urbana, IL;Coordinated Science Laboratory, Unirversity of Illinois at Urbana-Champaign, Urbana, IL;Coordinated Science Laboratory, Unirversity of Illinois at Urbana-Champaign, Urbana, IL

  • Venue:
  • ACC'09 Proceedings of the 2009 conference on American Control Conference
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper is concerned with an information-theoretic framework to aggregate a large-scale Markov chain to obtain a reduced order Markov model. The Kullback-Leibler (K-L) divergence rate is employed as a metric to measure the distance between two stationary Markov chains. Model reduction is obtained by considering an optimization problem with respect to this metric. The solution is just the optimal aggregated Markov model. We show that the solution of the bi-partition problem is given by an eigenvalue problem. To construct a reduced order model with m super-states, a recursive algorithm is proposed and illustrated with examples.