Rigorous confidence bounds for MCMC under a geometric drift condition

  • Authors:
  • Krzysztof Łatuszyński;Wojciech Niemiro

  • Affiliations:
  • Department of Statistics, University of Warwick, CV4 7AL, Coventry, UK;Faculty of Mathematics and Computer Science, Nicolaus Copernicus University, Chopina 12/18, 87-100 Toruń, Poland and Institute of Applied Mathematics and Mechanics, University of Warsaw, Bana ...

  • Venue:
  • Journal of Complexity
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We assume a drift condition towards a small set and bound the mean square error of estimators obtained by taking averages along a single trajectory of a Markov chain Monte Carlo algorithm. We use these bounds to construct fixed-width nonasymptotic confidence intervals. For a possibly unbounded function f:X-R, let I(f)=@!"Xf(x)@p(dx) be the value of interest and I@?"t","n(f)=(1/n)@?"i"="t^t^+^n^-^1f(X"i) its MCMC estimate. Precisely, we derive lower bounds for the length of the trajectory n and burn-in time t which ensure that P(|I@?"t","n(f)-I(f)|@?@e)=1-@a. The bounds depend only and explicitly on drift parameters, on the V-norm of f, where V is the drift function and on precision and confidence parameters @e,@a. Next we analyze an MCMC estimator based on the median of multiple shorter runs that allows for sharper bounds for the required total simulation cost. In particular the methodology can be applied for computing posterior quantities in practically relevant models. We illustrate our bounds numerically in a simple example.