Entropy estimators and serial tests for ergodic chains

  • Authors:
  • S. Wegenkittl

  • Affiliations:
  • Inst. fur Math., Salzburg Univ.

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2001

Quantified Score

Hi-index 754.84

Visualization

Abstract

Maurer (1992, A universal statistical test for random bit generators) discussed a statistic whose value is closely related to the per-bit-entropy of an ergodic stationary source. Here we derive an entropy estimate from a class of generalized serial tests and discuss its relationship to return-time-based entropy estimators and frequency-based goodness-of-fit tests. Our setup extends Kullback's I-divergence approach for independent stationary sequences to the class of ergodic Markov chains. The effects caused by the order of the source are examined theoretically and by an empirical study