A new approach to hand tracking and gesture recognition by a new feature type and HMM

Authors:
Pham The Bao;Nguyen Thanh Binh;Tu Duy Khoa
Affiliations:
Faculty of Mathematics and Computer Science, University of Science, Ho Chi Minh City;Faculty of Mathematics and Computer Science, University of Science, Ho Chi Minh City;Faculty of Mathematics and Computer Science, University of Science, Ho Chi Minh City
Venue:
FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 4
Year:
2009

Citing 3
Cited 0

A Survey of Glove-based Input

IEEE Computer Graphics and Applications
Recognizing hand gestures

ECCV '94 Proceedings of the third European conference on Computer vision (vol. 1)
Mean Shift, Mode Seeking, and Clustering

IEEE Transactions on Pattern Analysis and Machine Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we introduce a hand gesture recognition system to recognize real time gestures in Vietnamese sign language system. In our system, there are three modules: real time hand tracking, training gesture and gesture recognition using pseudo two dimension hidden Markov models (P2-DHMMs). In the hand tracking module, we introduce a new robust algorithm to obtain hand region, called Tower method, and use skin color for hand gesture tracking and recognition. Next, a gesture recognition system is developed, which can reliably recognize single hand gesture on a standard camera. Furthermore, we propose a new feature type in gesture recognition to improve the accuracy of overall system. In the experiments, we have tested our system to vocabulary of 29 gestures in Vietnamese sign language system (VSL), and show the effectiveness of the system and Tower method.