A constructive proof of the existence of Viterbi processes

  • Authors:
  • Jüri Lember;Alexey Alexandrovich Koloydenko

  • Affiliations:
  • Institute of Mathematical Statistics, Tartu University, Tartu, Estonia;Mathematics Department of Royal Holloway, University of London, Egham, UK

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2010

Quantified Score

Hi-index 754.84

Visualization

Abstract

Since the early days of digital communication, hidden Markov models (HMMs) have now been also routinely used in speech recognition, processing of natural languages, images, and in bioinformatics. In an HMM (Xt, Yt)t ≥ 1, observations X1, X2,... are assumed to be conditionally independent given a Markov process Y1, Y2,..., which itself is not observed; moreover, the conditional distribution of Xt depends solely on Yt. Central to the theory and applications of HMM is the Viterbi algorithm to find a maximum a posteriori probability (MAP) estimate v(x1:T) = (v1, v2..., vT) of Y1:T given observed data x1:T. Maximum a posteriori paths are also known as the Viterbi paths, or alignments. Recently, attempts have been made to study behavior of the Viterbi alignments when T → ∞. Thus, it has been shown that in some cases a well-defined limiting Viterbi alignment exists. While innovative, these attempts have relied on rather strong assumptions and involved proofs which are existential. This work proves the existence of infinite Viterbi alignments in a more constructive manner and for a very general class of HMMs.