Real-time 3d arm pose estimation from monocular video for enhanced HCI

Authors:
Samuele Salti;Oliver Schreer;Luigi Di Stefano
Affiliations:
University of Bologna, Bologna, Italy;Heinrich-Hertz-Institute, Berlin, Germany;University of Bologna, Bologna, Italy
Venue:
VNBA '08 Proceedings of the 1st ACM workshop on Vision networks for behavior analysis
Year:
2008

Citing 8
Cited 2

Reliable Tracking of Human Arm Dynamics by Multiple Cue Integration and Constraint Fusion

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Monocular tracking of the human arm in 3D

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Modelling and estimating the pose of a human arm

Machine Vision and Applications - Special issue: Human modeling, analysis, and synthesis
Towards real-time 3-D monocular visual tracking of human limbs in unconstrained environments

Real-Time Imaging
Robust real-time upper body limb detection and tracking

Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks
A survey of advances in vision-based human motion capture and analysis

Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Real-time upper body detection and 3d pose estimation in monoscopic images

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part III
Real-Time avatar animation steered by live body motion

ICIAP'05 Proceedings of the 13th international conference on Image Analysis and Processing

Real time multiple people tracking and pose estimation

Proceedings of the 1st ACM international workshop on Multimodal pervasive video analysis
Human sign recognition for robot manipulation

MCPR'12 Proceedings of the 4th Mexican conference on Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper an approach for 3D arm pose estimation from a monocular video is presented. Our proposal has been designed to provide real-time and realistic reconstruction of the user motion, as required by advanced Human Computer Interaction (HCI) applications. Both a 2D arm tracking and a 3D arm pose estimation algorithm are introduced and discussed. Tracking exploits fast and robust segmentation of the arm silhouette together with detection and tracking of skin colored regions. 3D pose estimation relies on a stick-figure arm model and the Analysis-by-Synthesis approach, but achieves real-time performance using geometrical constraints on tracking results to reduce the search space cardinality. Experiments on the animation of 3D avatars using off-the-shelf hardware demonstrate the effectiveness and real-time performance of our proposal.