ON THE CONVERGENCE OF METROPOLIS-TYPE RELAXATION AND ANNEALING WITH CONSTRAINTS

  • Authors:
  • Marc C. Robini;Yoram Bresler;Isabelle E. Magnin

  • Affiliations:
  • CREATIS, UMR CNRS 5515, INSA Lyon, Villeurbanne, France, E-mail: marc.robini@creatis.insa-lyon.fr;Coordinated Science Laboratory, University of Illinois at Urbana-Champaign, Urbana, IL 61801, E-mail: ybresler@uiuc.edu;CREATIS, UMR CNRS 5515, INSA Lyon, Villeurbanne, France

  • Venue:
  • Probability in the Engineering and Informational Sciences
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We discuss the asymptotic behavior of time-inhomogeneous Metropolis chains for solving constrained sampling and optimization problems. In addition to the usual inverse temperature schedule (&bgr;n)n∈[hollow N]*, the type of Markov processes under consideration is controlled by a divergent sequence (θn)n∈[hollow N]* of parameters acting as Lagrange multipliers. The associated transition probability matrices (P&bgr;n,θn)n∈[hollow N]* are defined by P&bgr;,θ = q(x, y)exp(−&bgr;(Wθ(y) − Wθ(x))+) for all pairs (x, y) of distinct elements of a finite set &OHgr;, where q is an irreducible and reversible Markov kernel and the energy function Wθ is of the form Wθ = U + θV for some functions U,V : &OHgr; → [hollow R]. Our approach, which is based on a comparison of the distribution of the chain at time n with the invariant measure of P&bgr;n,θn, requires the computation of an upper bound for the second largest eigenvalue in absolute value of P&bgr;n,θn. We extend the geometric bounds derived by Ingrassia and we give new sufficient conditions on the control sequences for the algorithm to simulate a Gibbs distribution with energy U on the constrained set [&OHgr; with tilde above] = {x ∈ &OHgr; : V(x) = minz∈&OHgr; V(z)} and to minimize U over [&OHgr; with tilde above].