Iterated logarithmic expansions of the pathwise code lengths for exponential families

  • Authors:
  • Lei Li;Bin Yu

  • Affiliations:
  • Dept. of Stat., Florida State Univ., Tallahassee, FL;-

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2006

Quantified Score

Hi-index 754.84

Visualization

Abstract

Rissanen's (1978, 1986, 1989, 1996) minimum description length (MDL) principle is a statistical modeling principle motivated by coding theory. For exponential families we obtain pathwise expansions, to the constant order, of the predictive and mixture codelengths used in MDL. The results are useful for understanding different MDL forms