Estimation of the information by an adaptive partitioning of the observation space

  • Authors:
  • G. A. Darbellay;I. Vajda

  • Affiliations:
  • Inst. of Inf. Theory & Autom., Czechoslovak Acad. of Sci., Prague;-

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2006

Quantified Score

Hi-index 754.84

Visualization

Abstract

We demonstrate that it is possible to approximate the mutual information arbitrarily closely in probability by calculating the relative frequencies on appropriate partitions and achieving conditional independence on the rectangles of which the partitions are made. Empirical results, including a comparison with maximum-likelihood estimators, are presented