An HMM-based Temporal Difference Learning with Model-Updating Capability for Visual Tracking of Human Communicational Behaviors

  • Authors:
  • Minh Anh T. Ho;Yoji Umetani

  • Affiliations:
  • -;-

  • Venue:
  • FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the development of natural interaction for systems, the trend of using vision toward translating human actions into instruction symbols is arising for the recognition of non-verbal communication channels. We propose an Adaptive Vision-based Attentive Tracker (AVAT) to track human intended communicational actions with attentive zooming capability as well as an exploration function for model updating. The AVAT isolates such human intended actions from the ordinary walking behavior based on an algorithm with two sub-processes: one is for modeling the movement of human body parts as the environment using HMMs (Hidden Markov Models) algorithm, and the other is for learning the model of the tracker's action using a model-based TD (Temporal Difference) algorithm. In the paper, we describe the integration of the two algorithms and then derive the model updating formulas from the newly optimized TD policies. An experimental result of isolating the human sign action during his natural walking motion is shown for demonstrating the feasibility of our system. Identification of the sign gesture context using a confirmation method using wavelet analysis which provides rewards for optimizing the tracker's action models.