Shannon entropy vs. kolmogorov complexity

  • Authors:
  • An. Muchnik;N. Vereshchagin

  • Affiliations:
  • Institute of New Technologies, Moscow, Russia;Department of Mathematical Logic and Theory of Algorithms, Faculty of Mechanics and Mathematics, Moscow State University, Moscow, Russia

  • Venue:
  • CSR'06 Proceedings of the First international computer science conference on Theory and Applications
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most assertions involving Shannon entropy have their Kolmogorov complexity counterparts. A general theorem of Romashchenko [4] states that every information inequality that is valid in Shannon's theory is also valid in Kolmogorov's theory, and vice verse. In this paper we prove that this is no longer true for ∀∃-assertions, exhibiting the first example where the formal analogy between Shannon entropy and Kolmogorov complexity fails.