Exact minimax strategies for predictive density estimation, data compression, and model selection

Authors:
Feng Liang;A. Barron
Affiliations:
Inst. of Stat. & Decision Sci., Duke Univ., Durham, NC, USA;-
Venue:
IEEE Transactions on Information Theory
Year:
2006

Citing 0
Cited 6

A study of regularized Gaussian classifier in high-dimension small sample set case based on MDL principle with application to spectrum recognition

Pattern Recognition
Bayesian predictive densities based on superharmonic priors for the 2-dimensional Wishart model

Journal of Multivariate Analysis
MDL denoising revisited

IEEE Transactions on Signal Processing
Universal models for the exponential distribution

IEEE Transactions on Information Theory
Empirical Bayes predictive densities for high-dimensional normal models

Journal of Multivariate Analysis
Minimaxity in predictive density estimation with parametric constraints

Journal of Multivariate Analysis

Quantified Score

Hi-index	754.90

Visualization

Abstract

For location and scale families of distributions and related settings of linear regression, we determine minimax procedures for predictive density estimation, for universal data compression, and for the minimum description length (MDL) criterion for model selection. The analysis gives the best invariant and indeed minimax procedure for predictive density estimation by directly verifying extended Bayes properties or, alternatively, by general aspects of decision theory on groups which are shown to simplify in the case of Kullback-Leibler loss. An exact minimax rule is generalized Bayes using a uniform (Lebesgue measure) prior on the location and log-scale parameters, which is made proper by conditioning on an initial set of observations.