On-line identification of hidden Markov models via recursiveprediction error techniques

  • Authors:

  • I.B. Collings;V. Krishnamurthy;J.B. Moore

  • Affiliations:

  • Dept. of Syst. Eng., Australian Nat. Univ., Canberra, ACT;-;-

  • Venue:
  • IEEE Transactions on Signal Processing
  • Year:
  • 1994

Quantified Score

Hi-index 35.69

Visualization

Abstract

An on-line state and parameter identification scheme for hidden Markov models (HMMs) with states in a finite-discrete set is developed using recursive prediction error (RPE) techniques. The parameters of interest are the transition probabilities and discrete state values of a Markov chain. The noise density associated with the observations can also be estimated. Implementation aspects of the proposed algorithms are discussed, and simulation studies are presented to show that the algorithms converge for a wide variety of initializations. In addition, an improved version of an earlier proposed scheme (the Recursive Kullback-Leibler (RKL) algorithm) is presented with a parameterization that ensures positivity of transition probability estimates