The context-tree weighting method: extensions

  • Authors:
  • F. M.J. Willems

  • Affiliations:
  • Dept. of Electr. Eng., Eindhoven Univ. of Technol.

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2006

Quantified Score

Hi-index 754.91

Visualization

Abstract

First we modify the basic (binary) context-tree weighting method such that the past symbols x1-D, x2-D, …, x 0 are not needed by the encoder and the decoder. Then we describe how to make the context-tree depth D infinite, which results in optimal redundancy behavior for all tree sources, while the number of records in the context tree is not larger than 2T-1. Here T is the length of the source sequence. For this extended context-tree weighting algorithm we show that with probability one the compression ratio is not larger than the source entropy for source sequence length T→∞ for stationary and ergodic sources