Minimum expected length of fixed-to-variable lossless compression of memoryless sources

  • Authors:
  • Wojciech Szpankowski;Sergio Verdú

  • Affiliations:
  • Department of Computer Science, Purdue University, W. Lafayette, IN;Department of Electrical Engineering, Princeton University, Princeton, NJ

  • Venue:
  • ISIT'09 Proceedings of the 2009 IEEE international conference on Symposium on Information Theory - Volume 1
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

Conventional wisdom states that the minimum expected length for fixed-to-variable length encoding of an n-block memoryless source with entropy H grows as nH+O(1). However, this performance is obtained under the constraint that the code assigned to the whole n-block is a prefix code. Dropping this unnecessary constraint we show that the minimum expected length grows as nH - 1/2log n+O(1) unless the source is equiprobable.