Cross entropy, dissimilarity measures, and characterizations of quadratic entropy

  • Authors:
  • C. Rao;T. Nayak

  • Affiliations:
  • -;-

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2006

Quantified Score

Hi-index 754.84

Visualization

Abstract

A unified approach is given for constructing cross entropy and dissimilarity measures between probability distributions, based on a given entropy function or a diversity measure. Special properties of quadratic entropy introduced by Rao [7] are described. In particular it is shown that the square root of the Jensen difference (dissimilarity measure) arising out of a quadratic entropy provides a metric on a probability space. Several characterizations of quadratic entropy are obtained.