Tunstall adaptive coding and miscoding

  • Authors:
  • F. Fabris;A. Sgarro;R. Pauletti

  • Affiliations:
  • Dipartimento di Matematica e Inf., Udine Univ.;-;-

  • Venue:
  • IEEE Transactions on Information Theory - Part 2
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the first part of this paper, we tackle the case where a variable length-to-block Tunstall code is used to encode the wrong source (miscoding). It turns out that, exactly as happens in the case with Huffman coding, the asymptotic excess rate is given by the informational divergence between the probability distribution ruling the source and the probability distribution for which the Tunstall code had been devised. We also prove asymptotic equality between the individual rate of a codeword and the corresponding self-information. This allows us to bound the maximal and the minimal length in a Tunstall tree. In the second part of the paper we study the case where the probability distribution of the source changes in time. If this happens, it is necessary to frequently update the current code, to ensure that the optimality conditions concerning its rate are met. This coding procedure is known as adaptive coding. We propose some schemes for adaptive Tunstall coding, based on the structure of the coding tree, on the “ordering property”, analogous to Gallager's (1978) sibling property of the Huffman code, and on the “Tunstall regions”, analogous to the attraction regions due to Longo and Galasso (1982)