Interactive spacetime control for animation
SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
Physically based motion transformation
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Reconstruction of articulated objects from point correspondences in a single uncalibrated image
Computer Vision and Image Understanding
SIGGRAPH '88 Proceedings of the 15th annual conference on Computer graphics and interactive techniques
Mean Shift: A Robust Approach Toward Feature Space Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Implicit Probabilistic Models of Human Motion for Synthesis and Tracking
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Specialized mappings and the estimation of human body pose from a single image
HUMO '00 Proceedings of the Workshop on Human Motion (HUMO'00)
Twist Based Acquisition and Tracking of Animal and Human Kinematics
International Journal of Computer Vision
Generative modeling for continuous non-linearly embedded visual inference
ICML '04 Proceedings of the twenty-first international conference on Machine learning
Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces
ACM SIGGRAPH 2004 Papers
Adaptation of performed ballistic motion
ACM Transactions on Graphics (TOG)
Performance animation from low-dimensional control signals
ACM SIGGRAPH 2005 Papers
Learning physics-based motion style with nonlinear inverse optimization
ACM SIGGRAPH 2005 Papers
Priors for People Tracking from Small Training Sets
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Recovering 3D Human Pose from Monocular Images
IEEE Transactions on Pattern Analysis and Machine Intelligence
BM3E: Discriminative Density Propagation for Visual Tracking
IEEE Transactions on Pattern Analysis and Machine Intelligence
Inferring 3D body pose from silhouettes using activity manifold learning
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
MovieReshape: tracking and reshaping of humans in videos
ACM SIGGRAPH Asia 2010 papers
Physically valid statistical models for human motion generation
ACM Transactions on Graphics (TOG)
Web-based nonverbal communication interface using 3D agents with natural gestures
HCII'11 Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II
Three-dimensional proxies for hand-drawn characters
ACM Transactions on Graphics (TOG)
Video-based 3D motion capture through biped control
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Efficient articulated trajectory reconstruction using dynamic programming and filters
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Video-based hand manipulation capture through composite motion control
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Model based full body human motion reconstruction from video data
Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
On-set performance capture of multiple actors with a stereo camera
ACM Transactions on Graphics (TOG)
Motion capture and human pose reconstruction from a single-view video sequence
Digital Signal Processing
| Hi-index | 0.00 |
This paper presents a video-based motion modeling technique for capturing physically realistic human motion from monocular video sequences. We formulate the video-based motion modeling process in an image-based keyframe animation framework. The system first computes camera parameters, human skeletal size, and a small number of 3D key poses from video and then uses 2D image measurements at intermediate frames to automatically calculate the "in between" poses. During reconstruction, we leverage Newtonian physics, contact constraints, and 2D image measurements to simultaneously reconstruct full-body poses, joint torques, and contact forces. We have demonstrated the power and effectiveness of our system by generating a wide variety of physically realistic human actions from uncalibrated monocular video sequences such as sports video footage.