Hidden-Markov-model-based hand gesture recognition techniques used for a human-robot interaction system

Authors:
Chin-Shyurng Fahn;Keng-Yu Chu
Affiliations:
Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taiwan, Republic of China;Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taiwan, Republic of China
Venue:
HCII'11 Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II
Year:
2011

Citing 5
Cited 0

Handwritten Word Recognition Using Segmentation-Free Hidden Markov Modeling and Segmentation-Based Dynamic Programming Techniques

IEEE Transactions on Pattern Analysis and Machine Intelligence
Segmenting Hands of Arbitrary Color

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Model Structure Selection and Training Algorithms for an HMM Gesture Recognition System

IWFHR '04 Proceedings of the Ninth International Workshop on Frontiers in Handwriting Recognition
Improved Face and Hand Tracking for Sign Language Recognition

ITCC '05 Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'05) - Volume II - Volume 02
Gesture Recognition: A Survey

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present part of a human-robot interaction system that recognizes meaningful gestures composed of continuous hand motions in real time based on hidden Markov models. This system acting as an interface is used for humans making various kinds of hand gestures to issue specific commands for conducting robots. To accomplish this, we define four basic types of directive gestures made by a single hand, which are moving upward, downward, leftward, and rightward individually. They serve as fundamental conducting gestures. Thus, if another hand is incorporated to making gestures, there are at most twenty-four kinds of compound gestures by the combination of the directive gestures using both hands. At present, we prescribe eight kinds of compound gestures employed in our developed human-robot interaction system, each of which is assigned a motion or functional control command, including moving forward, moving backward, turning left, turning right, stop, robot following, robot waiting, and ready, so that users can easily operate an autonomous robot. Experimental results reveal that our system can achieve an average gesture recognition rate of 96% at least. It is very satisfactory and encouraged.