A real-time multi-cue hand tracking algorithm based on computer vision

Authors:
Zhigeng Pan; Yang Li; Mingmin Zhang; Chao Sun; Kangde Guo; Xing Tang;Steven Zhiying Zhou
Affiliations:
State Key Lab. of CAD&CG, Zhejiang Univ., Hanyzhou, China;State Key Lab. of CAD&CG, Zhejiang Univ., Hanyzhou, China;State Key Lab. of CAD&CG, Zhejiang Univ., Hanyzhou, China;State Key Lab. of CAD&CG, Zhejiang Univ., Hanyzhou, China;State Key Lab. of CAD&CG, Zhejiang Univ., Hanyzhou, China;-;Dept. of Electr. Comput. Eng., Nat. Univ. of Singapore, Singapore, Singapore
Venue:
VR '10 Proceedings of the 2010 IEEE Virtual Reality Conference
Year:
2010

Citing 0
Cited 8

Robust hand posture recognition integrating multi-cue hand tracking

Edutainment'10 Proceedings of the Entertainment for education, and 5th international conference on E-learning and games
2D motion detection bounded hand 3D trajectory tracking and gesture recognition under complex background

Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry
Real-time 3D markerless multiple hand detection and tracking for human computer interaction applications

Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry
A real-time bimanual 3D interaction method based on bare-hand tracking

MM '11 Proceedings of the 19th ACM international conference on Multimedia
A virtual informal learning system for cultural heritage

Transactions on Edutainment VII
Improved hand tracking and isolation from face by ICondensation multi clue algorithm for continuous indian sign language recognition

ADCONS'11 Proceedings of the 2011 international conference on Advanced Computing, Networking and Security
Real-time fingertip tracking and detection using Kinect depth sensor for a new writing-in-the air system

Proceedings of the 4th International Conference on Internet Multimedia Computing and Service
A case study of user immersion-based systematic design for serious heritage games

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Although hand tracking algorithm has been widely used in virtual reality and HCI system, it is still a challenging problem in vision-based research area. Due to the robustness and real-time requirements in VR applications, most hand tracking algorithms require special device to achieve satisfactory results. In this paper, we propose an easy-to-use and inexpensive approach to track the hands accurately with a single normal webcam. Outstretched hand is detected by contour & curvature based detection techniques to initialize the tracking region. Robust multi-cue hand tracking is then achieved by velocity-weighted features and color cue. Experiments show that the proposed multi-cue hand tracking approach achieves continuous real-time results even for the situation of cluttered background. The approach fulfills the speed and accuracy requirements of frontal-view vision-based human computer interactions.