Reconstruct 3D human motion from monocular video using motion library

Authors:
Wenzhong Wang;Xianjie Qiu;Zhaoqi Wang;Rongrong Wang;Jintao Li
Affiliations:
Institute of Computing Technology, Chinese Academy of Sciences and Key Laboratory of Intelligent Information Processing, Chinese Academy of Sciences and Graduate School of Chinese Academy of Scien ...;Institute of Computing Technology, Chinese Academy of Sciences;Institute of Computing Technology, Chinese Academy of Sciences;Institute of Computing Technology, Chinese Academy of Sciences and Key Laboratory of Intelligent Information Processing, Chinese Academy of Sciences;Institute of Computing Technology, Chinese Academy of Sciences
Venue:
MMM'08 Proceedings of the 14th international conference on Advances in multimedia modeling
Year:
2008

Citing 11
Cited 0

An efficient cost scaling algorithm for the assignment problem

Mathematical Programming: Series A and B
Approximate nearest neighbors: towards removing the curse of dimensionality

STOC '98 Proceedings of the thirtieth annual ACM symposium on Theory of computing
Reconstruction of articulated objects from point correspondences in a single uncalibrated image

Computer Vision and Image Understanding
Tracking persons in monocular image sequences

Computer Vision and Image Understanding
A coordinate-invariant approach to multiresolution motion analysis

Graphical Models
Shape Matching and Object Recognition Using Shape Contexts

IEEE Transactions on Pattern Analysis and Machine Intelligence
Implicit Probabilistic Models of Human Motion for Synthesis and Tracking

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Recovering 3D Human Pose from Monocular Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Markerless monocular motion capture using image features and physical constraints

CGI '05 Proceedings of the Computer Graphics International 2005
Kinematic jump processes for monocular 3D human tracking

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
A video-driven approach to continuous human motion synthesis

CGI'06 Proceedings of the 24th international conference on Advances in Computer Graphics

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present a new approach to reconstruct 3D human motion from video clips with the assistance of a precaputred motion library. Given a monocular video clip recording of one person performing some kind of locomotion and a motion library consisting of similar motions, we can infer the 3D motion from the video clip. We segment the video clip into segments with fixed length, and by using a shape matching method we can find out from the motion library several candidate motion sequences for every video segment, then from these sequences a coarse motion clip is generated by performing a continuity test on the boundaries of these candidate sequences. We propose a pose deformation algorithm to refine the coarse motion. To guarantee the naturalness of the recovered motion, we apply a motion splicing algorithm to the motion clip. We tested the approach using synthetic and real sports videos. The experimental results show the effectiveness of this approach.