Real-Time markerless hand gesture recognition with depth camera

Authors:
Shuxin Qin;Xiaoyang Zhu;Haitao Yu;Shuiying Ge;Yiping Yang;Yongshi Jiang
Affiliations:
The Integrated Information System Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China;The Integrated Information System Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China;The Integrated Information System Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China;The Integrated Information System Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China;The Integrated Information System Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China;The Integrated Information System Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China
Venue:
PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
Year:
2012

Citing 16
Cited 1

Feature Detection with Automatic Scale Selection

International Journal of Computer Vision
Loops in reeb graphs of 2-manifolds

Proceedings of the nineteenth annual symposium on Computational geometry
Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Joint bilateral upsampling

ACM SIGGRAPH 2007 papers
Hand Gesture Recognition Using Fast Multi-scale Analysis

ICIG '07 Proceedings of the Fourth International Conference on Image and Graphics
Multithreaded Hybrid Feature Tracking for Markerless Augmented Reality

IEEE Transactions on Visualization and Computer Graphics
Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking

ISWC '07 Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers
Real-time hand-tracking with a color glove

ACM SIGGRAPH 2009 papers
Approximate convex decomposition of polygons

Computational Geometry: Theory and Applications
Vision-based hand-gesture applications

Communications of the ACM
3D deformable face tracking with a commodity depth camera

ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
Hand gesture recognition using depth data

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Vision-Based interpretation of hand gestures for remote control of a computer mouse

ECCV'06 Proceedings of the 2006 international conference on Computer Vision in Human-Computer Interaction
Real-time human pose recognition in parts from single depth images

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Lightweight palm and finger tracking for real-time 3D gesture control

VR '11 Proceedings of the 2011 IEEE Virtual Reality Conference

Real-time Hand Gesture Recognition from Depth Images Using Convex Shape Decomposition Method

Journal of Signal Processing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a novel method for markerless hand gesture recognition with a recently developed depth sensor. The proposed method encompasses a collection of techniques that enable the modeling and recognition of hand gestures. Hand detection and location are processed with the depth information acquired from a depth sensor. Then, the hand is robustly segmented in cluttered background without any marker around using only depth information. A convex shape decomposition method based on Radius Morse function is proposed for hand shape decomposition in real time. Hand palm and fingertips are recognized based on the hand shape decomposition and hand features. A prototype implementation of the developed system operates on 640x480 live video with both depth image and color image in real time on a conventional processor. Representative experimental results prove the accuracy, efficiency and robustness of our method.