Comparison of approaches to continuous hand gesture recognition for a visual dialog system

Authors:
P. Morguet;M. Lang
Affiliations:
Inst. for Human-Machine-Commun., Munchen Univ. of Technol., Germany;-
Venue:
ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 06
Year:
1999

Citing 0
Cited 3

A generic approach for interfacing VRML browsers to various input devices and creating customizable 3D applications

Proceedings of the seventh international conference on 3D Web technology
Using multimodal interaction to navigate in arbitrary virtual VRML worlds

Proceedings of the 2001 workshop on Perceptive user interfaces
A multidimensional dynamic time warping algorithm for efficient multimodal fusion of asynchronous data streams

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Continuous hand gesture recognition requires the detection of gestures in a video stream and their classification. In this paper two continuous recognition solutions using hidden Markov models (HMMs) are compared. The first approach uses a motion detection algorithm to isolate gesture candidates followed by a HMM recognition step. The second approach is a single-stage, HMM-based spotting method improved by a new implicit duration modeling. Both strategies have been tested on continuous video data containing 41 different types of gestures embedded in random motion. The data has been derived from usability experiments with an application providing a realistic visual dialog scenario. The results show that the improved spotting method in contrast to the motion detection approach can successfully suppress random motion providing excellent recognition results.