A real-time hand tracker using variable-length Markov models of behaviour

  • Authors:
  • Nikolay Stefanov;Aphrodite Galata;Roger Hubbold

  • Affiliations:
  • Advanced Interfaces Group, School of Computer Science, University of Manchester, Manchester M13 9PL, UK;Advanced Interfaces Group, School of Computer Science, University of Manchester, Manchester M13 9PL, UK;Advanced Interfaces Group, School of Computer Science, University of Manchester, Manchester M13 9PL, UK

  • Venue:
  • Computer Vision and Image Understanding
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel approach for visual tracking of structured behaviour as observed in human-computer interaction. An automatically acquired variable-length Markov model is used to represent the high-level structure and temporal ordering of gestures. Continuous estimation of hand posture is handled by combining the model with annealed particle filtering. The stochastic simulation updates and automatically switches between different model representations of hand posture that correspond to distinct gestures. The implementation executes in real time and demonstrates significant improvement in robustness over comparable methods. We provide a measurement of user performance when our method is applied to a Fitts' law drag-and-drop task, and an analysis of the effects of latency that it introduces.