Efficient on-line schemes for encoding individual sequences with side information at the decoder
ISIT'09 Proceedings of the 2009 IEEE international conference on Symposium on Information Theory - Volume 2
A universal scheme for Wyner-Ziv coding of discrete sources
IEEE Transactions on Information Theory
| Hi-index | 754.90 |
We consider a variation of the Wyner-Ziv (W-Z) problem pertaining to lossy compression of individual sequences using finite-state encoders and decoders. There are two main results in this paper. The first characterizes the relationship between the performance of the best M-state encoder-decoder pair to that of the best block code of size lscr for every input sequence, and shows that the loss of the latter relative to the former (in terms of both rate and distortion) never exceeds the order of (logM)/lscr, independently of the input sequence. Thus, in the limit of large M, the best rate-distortion performance of every infinite source sequence can be approached universally by a sequence of block codes (which are also implementable by finite-state machines). While this result assumes an asymptotic regime where the number of states is fixed, and only the length n of the input sequence grows without bound, we then consider the case where the number of states M=Mn is allowed to grow concurrently with n. Our second result is then about the critical growth rate of Mn such that the rate-distortion performance of Mn-state encoder-decoder pairs can still be matched by a universal code. We show that this critical growth rate of Mn is linear in n