Optimal Alphabet Partitioning for Semi-Adaptive Coding of Sources of Unknown Sparse Distributions

  • Authors:
  • Dan Chen;Yi-Jen Chiang;Nasir Memon;Xiaolin Wu

  • Affiliations:
  • -;-;-;-

  • Venue:
  • DCC '03 Proceedings of the Conference on Data Compression
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Practical applications that employ entropy coding for large alphabets oftenpartition the alphabet set into two or more layers and encode each symbolby using some suitable prefix coding for each layer.In this paper we formulatethe problem of optimal alphabet partitioning for the design of a twolayer semi-adaptive code and give a solution based on dynamic programming.However, the complexity of the dynamic programming approach can be quiteprohibitive for a long sequence and a very large alphabet size.Hence, we givea simple greedy heuristic algorithm whose running time is linear in the numberof symbols being encoded, irrespective of the underlying alphabet size.Wegive experimental results that demonstrate the fact that superior prefix codingsschemes for large alphabets can be designed using our approach as opposed tothe typically ad-hoc partitoning approach applied in the literature.