Tracking pointing gesture in 3D space for wearable visual interfaces

Authors:
Yunde Jia;Shanqing Li;Yang Liu
Affiliations:
Beijing Institute of Technology, Beijing, China;Beijing Institute of Technology, Beijing, China;Beijing Institute of Technology, Beijing, China
Venue:
Proceedings of the international workshop on Human-centered multimedia
Year:
2007

Citing 8
Cited 1

Camera Calibration with Distortion Models and Accuracy Evaluation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Interacting with paper on the DigitalDesk

Communications of the ACM - Special issue on computer augmented environments: back to the real world
CONDENSATION—Conditional Density Propagation forVisual Tracking

International Journal of Computer Vision
Detection and Estimation of Pointing Gestures in Dense Disparity Maps

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Arm-Pointing Gesture Interface Using Surrounded Stereo Cameras System

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4 - Volume 04
Integrating context-free and context-dependent attentional mechanisms for gestural object reference

Machine Vision and Applications
3D-tracking of head and hands for pointing gesture recognition in a human-robot interaction scenario

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Visual capture and understanding of hand pointing actions in a 3-D environment

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

2D motion detection bounded hand 3D trajectory tracking and gesture recognition under complex background

Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a practical method of tracking pointing gesture in 3D space for wearable visual interfaces. We integrate dense depth maps and contour cues to achieve more stable tracking performance. A strategy of fusing information from selective attention maps and synthetical feature maps is presented for locating the focus of attention pointed at by pointing gesture. We have developed a wearable stereo vision system for pointing gesture tracking, called POGEST, with FPGA-based dense depth mapping at video rate. The system enables a wearer to locate and select an object in 3D space using his/her pointing hand. A common focus of attention shared by a wearer and a computer is established for natural human computer interaction. We also discuss an application of locating objects in 3D virtual environments.