Metropolis---Hastings algorithms with adaptive proposals

  • Authors:
  • Bo Cai;Renate Meyer;François Perron

  • Affiliations:
  • Department of Epidemiology and Biostatistics, University of South Carolina, Columbia, USA 29208;Department of Statistics, University of Auckland, Auckland, New Zealand Private Bag 92019;Department of Mathematics and Statistics, University of Montreal, Montreal, Canada H3C 3J7

  • Venue:
  • Statistics and Computing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Different strategies have been proposed to improve mixing and convergence properties of Markov Chain Monte Carlo algorithms. These are mainly concerned with customizing the proposal density in the Metropolis---Hastings algorithm to the specific target density and require a detailed exploratory analysis of the stationary distribution and/or some preliminary experiments to determine an efficient proposal. Various Metropolis---Hastings algorithms have been suggested that make use of previously sampled states in defining an adaptive proposal density. Here we propose a general class of adaptive Metropolis---Hastings algorithms based on Metropolis---Hastings-within-Gibbs sampling. For the case of a one-dimensional target distribution, we present two novel algorithms using mixtures of triangular and trapezoidal densities. These can also be seen as improved versions of the all-purpose adaptive rejection Metropolis sampling (ARMS) algorithm to sample from non-logconcave univariate densities. Using various different examples, we demonstrate their properties and efficiencies and point out their advantages over ARMS and other adaptive alternatives such as the Normal Kernel Coupler.