An Algorithm for Universal Lossless Compression With Side Information

  • Authors:
  • Haixiao Cai;S. R. Kulkarni;S. Verdu

  • Affiliations:
  • Dept. of Electr. Eng., Princeton Univ., NJ;-;-

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2006

Quantified Score

Hi-index 754.90

Visualization

Abstract

This paper proposes a new algorithm based on the Context-Tree Weighting (CTW) method for universal compression of a finite-alphabet sequence x1 n with side information y1 n available to both the encoder and decoder. We prove that with probability one the compression ratio converges to the conditional entropy rate for jointly stationary ergodic sources. Experimental results with Markov chains and English texts show the effectiveness of the algorithm