Ordering finite-state Markov channels by mutual information

  • Authors:
  • Andrew W. Eckford

  • Affiliations:
  • Department of Computer Science and Engineering, York University, Toronto, ON, Canada

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2009

Quantified Score

Hi-index 754.84

Visualization

Abstract

In this paper, an ordering result is given for Markov channels with respect to mutual information, under the assumption of an independent and identically distributed (i.i.d.) input distribution. For those Markov channels in which the capacity-achieving input distribution is i.i.d., this allows ordering of the channels by capacity. The complexity of analyzing general Markov channels is mitigated by this ordering, since it is possible to immediately determine that a wide class of channels, with different numbers of states, has a smaller mutual information than a given channel.