On the interplay between Shannon's information measures and reliability criteria

  • Authors:
  • Siu-Wai Ho

  • Affiliations:
  • Dept. of Information Engineering, The Chinese University of Hong Kong, Hong Kong

  • Venue:
  • ISIT'09 Proceedings of the 2009 IEEE international conference on Symposium on Information Theory - Volume 1
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the literature, different reliability criteria are used in different coding theorems. Weak secrecy and strong secrecy are frequently used in information-theoretic security problems and their implications in terms of the average symbol error probability and block error probability of the adversary are studied in this paper. In particular, strong secrecy always ensures that the adversary has maximum error probability but it is too difficult to be satisfied for a serial source. Weak secrecy can ensure the maximum error probability if the source is stationary and memoryless. In the second part of this paper, the relation among different reliability criteria for source or channel coding are shown. With this result, the channel coding theorem for discrete memoryless channel is generalized with a strong reliability criterion for the direct part and a weak reliability criterion for the converse part.