Hand trajectory-based gesture spotting and recognition using HMM

Authors:
Mahmoud Elmezain;Ayoub Al-Hamadi;Bernd Michaelis
Affiliations:
Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke-University Magdeburg, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke-University Magdeburg, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke-University Magdeburg, Germany
Venue:
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Year:
2009

Citing 6
Cited 2

An HMM-Based Threshold Model Approach for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Kernel-Based Object Tracking

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Neural Network Approach for Hand Gesture Recognition in Virtual Reality Driving Training System of SPG

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 03
Simultaneous gesture segmentation and recognition based on forward spotting accumulative HMMs

Pattern Recognition
Sign Language Spotting with a Threshold Model Based on Conditional Random Fields

IEEE Transactions on Pattern Analysis and Machine Intelligence
Gesture Spotting and Recognition for Human–Robot Interaction

IEEE Transactions on Robotics

A novel approach for gesture control video games based on perceptual features: modelling, tracking and recognition

International Journal of Computational Vision and Robotics
Context-based hand gesture recognition for the operating room

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose an automatic system that executes hand gesture spotting and recognition simultaneously without any time delay based on Hidden Markov Models (HMM). Our system is based on three main stages; preprocessing, feature extraction and classification. In preprocessing stage, color and 3D depth map are used to detect hands. The hand trajectory will take place in further steps using Mean-shift algorithm and Kalman filter. The second stage, Orientation dynamic features are obtained from spatio-temporal trajectories and then are quantized to generate its codewords. In the final stage, the gestures are segmented by finding the start and the end points of meaningful gestures that are embedded in the input stream and then are recognized by Viterbi algorithm. Experimental results demonstrate that, our system can successfully recognize spotted hand gestures with a 95.87% recognition rate for Arabic numbers from 0 to 9.