Markov Chains and Optimality of the Hamiltonian Cycle

  • Authors:
  • Nelly Litvak;Vladimir Ejov

  • Affiliations:
  • Faculty of Electrical Engineering, Mathematics and Computer Science, Department of Applied Mathematics, University of Twente, 7500 AE, Enschede, The Netherlands;Centre of Industrial and Applied Mathematics, School of Mathematics and Statistics, University of South Australia, Mawson Lakes, South Australia 5095, Australia

  • Venue:
  • Mathematics of Operations Research
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider the Hamiltonian cycle problem (HCP) embedded in a controlled Markov decision process. In this setting, HCP reduces to an optimization problem on a set of Markov chains corresponding to a given graph. We prove that Hamiltonian cycles are minimizers for the trace of the fundamental matrix on a set of all stochastic transition matrices. In case of doubly stochastic matrices with symmetric linear perturbation, we show that Hamiltonian cycles minimize a diagonal element of a fundamental matrix for all admissible values of the perturbation parameter. In contrast to the previous work on this topic, our arguments are primarily based on probabilistic rather than algebraic methods.