SIGGRAPH '86 Proceedings of the 13th annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
IEEE Transactions on Pattern Analysis and Machine Intelligence
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Tracking and modeling people in video sequences
Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
A signal-processing framework for inverse rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Frequency space environment map rendering
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Twist Based Acquisition and Tracking of Animal and Human Kinematics
International Journal of Computer Vision
"GrabCut": interactive foreground extraction using iterated graph cuts
ACM SIGGRAPH 2004 Papers
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
BRDF Invariant Stereo Using Light Transport Constancy
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Graph Cuts and Efficient N-D Image Segmentation
International Journal of Computer Vision
A survey of advances in vision-based human motion capture and analysis
Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Surface Capture for Performance-Based Animation
IEEE Computer Graphics and Applications
Seeing People in Different Light-Joint Shape, Motion, and Reflectance Capture
IEEE Transactions on Visualization and Computer Graphics
Vision-based human motion analysis: An overview
Computer Vision and Image Understanding
Articulated mesh animation from multi-view silhouettes
ACM SIGGRAPH 2008 papers
Performance capture from sparse multi-view video
ACM SIGGRAPH 2008 papers
ACM SIGGRAPH 2008 papers
Dynamic shape capture using multi-view photometric stereo
ACM SIGGRAPH Asia 2009 papers
International Journal of Computer Vision
Combined Region and Motion-Based 3D Tracking of Rigid and Articulated Objects
IEEE Transactions on Pattern Analysis and Machine Intelligence
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
VideoMocap: modeling physically realistic human motion from monocular video sequences
ACM SIGGRAPH 2010 papers
Joint estimation of motion, structure and geometry from stereo sequences
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Animation cartography—intrinsic reconstruction of shape and motion
ACM Transactions on Graphics (TOG)
High accuracy optical flow serves 3-d pose tracking: exploiting contour and flow based constraints
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
POSECUT: simultaneous segmentation and 3D pose estimation of humans using dynamic graph-cuts
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
Real-time human pose recognition in parts from single depth images
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Markerless motion capture of interacting characters using multi-view image segmentation
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
The Vitruvian manifold: Inferring dense correspondences for one-shot human pose estimation
CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Fast articulated motion tracking using a sums of Gaussians body model
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Shading-based dynamic shape refinement from multi-view video under general illumination
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Lightweight binocular facial performance capture under uncontrolled lighting
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Accurate realtime full-body motion capture using a single depth camera
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Improved reconstruction of deforming surfaces by cancelling ambient occlusion
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Full body performance capture under uncontrolled and varying illumination: a shading-based approach
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
| Hi-index | 0.00 |
State-of-the-art marker-less performance capture algorithms reconstruct detailed human skeletal motion and space-time coherent surface geometry. Despite being a big improvement over marker-based motion capture methods, they are still rarely applied in practical VFX productions as they require ten or more cameras and a studio with controlled lighting or a green screen background. If one was able to capture performances directly on a general set using only the primary stereo camera used for principal photography, many possibilities would open up in virtual production and previsualization, the creation of virtual actors, and video editing during post-production. We describe a new algorithm which works towards this goal. It is able to track skeletal motion and detailed surface geometry of one or more actors from footage recorded with a stereo rig that is allowed to move. It succeeds in general sets with uncontrolled background and uncontrolled illumination, and scenes in which actors strike non-frontal poses. It is one of the first performance capture methods to exploit detailed BRDF information and scene illumination for accurate pose tracking and surface refinement in general scenes. It also relies on a new foreground segmentation approach that combines appearance, stereo, and pose tracking results to segment out actors from the background. Appearance, segmentation, and motion cues are combined in a new pose optimization framework that is robust under uncontrolled lighting, uncontrolled background and very sparse camera views.