Duality between channel capacity and rate distortion with two-sided state information

  • Authors:
  • T. M. Cover;Mung Chiang

  • Affiliations:
  • Dept. of Electr. Eng., Stanford Univ., CA;-

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2006

Quantified Score

Hi-index 754.84

Visualization

Abstract

We show that the duality between channel capacity and data compression is retained when state information is available to the sender, to the receiver, to both, or to neither. We present a unified theory for eight special cases of channel capacity and rate distortion with state information, which also extends existing results to arbitrary pairs of independent and identically distributed (i.i.d.) correlated state information (S1, S2) available at the sender and at the receiver, respectively. In particular, the resulting general formula for channel capacity C = maxp(u,x|s1) [I(U; S2, Y) I(U; S1)] assumes the same form as the generalized Wyner-Ziv (1976) rate distortion function R(D) = minp(u|x, s1)p(x&capped;|u, s2) [I(U; S 1, X) 1(U; S2)]