Some properties of Rényi entropy and Rényi entropy rate

  • Authors:
  • Leila Golshani;Einollah Pasha;Gholamhossein Yari

  • Affiliations:
  • Islamic Azad University, Science & Research Branch, Department of Statistics, P.O. Box 14155-4933, Tehran 1477893855, Iran;Tarbiat Moallem University, Tehran, Iran;University of Science and Technology, Tehran, Iran

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 2009

Quantified Score

Hi-index 0.07

Visualization

Abstract

In this paper, we define the conditional Renyi entropy and show that the so-called chain rule holds for the Renyi entropy. Then, we introduce a relation for the rate of Renyi entropy and use it to derive the rate of the Renyi entropy for an irreducible-aperiodic Markov chain. We also show that the bound for the Renyi entropy rate is simply the Shannon entropy rate.