Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
A survey of computer vision-based human motion capture
Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
Articulated body deformation from range scan data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Object Recognition from Local Scale-Invariant Features
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Continuous capture of skin deformation
ACM SIGGRAPH 2003 Papers
Articulated Soft Objects for Multiview Shape and Motion Capture
IEEE Transactions on Pattern Analysis and Machine Intelligence
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Differential Coordinates for Interactive Mesh Editing
SMI '04 Proceedings of the Shape Modeling International 2004
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
SCAPE: shape completion and animation of people
ACM SIGGRAPH 2005 Papers
Capturing and animating skin deformation in human motion
ACM SIGGRAPH 2006 Papers
Subspace gradient domain mesh deformation
ACM SIGGRAPH 2006 Papers
An Adaptive Appearance Model Approach for Model-based Articulated Object Tracking
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Monocular model-based 3D tracking of rigid objects
Foundations and Trends® in Computer Graphics and Vision
ACM Computing Surveys (CSUR)
Markerless tracking of complex human motions from multiple views
Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Cloth x-ray: mocap of people wearing textiles
DAGM'06 Proceedings of the 28th conference on Pattern Recognition
Carved visual hulls for image-based modeling
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
High accuracy optical flow serves 3-d pose tracking: exploiting contour and flow based constraints
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
Template deformation for point cloud fitting
SPBG'06 Proceedings of the 3rd Eurographics / IEEE VGTC conference on Point-Based Graphics
Performance capture from sparse multi-view video
ACM SIGGRAPH 2008 papers
Keypoints and Local Descriptors of Scalar Functions on 2D Manifolds
International Journal of Computer Vision
Estimating scene flow using an interconnected patch surface model with belief-propagation inference
Computer Vision and Image Understanding
| Hi-index | 0.00 |
We present a novel algorithm that robustly tracks 3D trajectories of features on a moving human who has been recorded with multiple video cameras. Our method does so without special markers in the scene and can be used to track subjects wearing everyday apparel. By using the paths of the 3D points as constraints in a fast mesh deformation approach, we can directly animate a static human body scan such that it performs the same motion as the captured subject. Our method can therefore be used to directly animate high quality geometry models from unaltered video data which opens the door to new applications in motion capture, 3D Video and computer animation. Since our method does not require a kinematic skeleton and only employs a handful of feature trajectories to generate lifelike animations with realistic surface deformations, it can also be used to track subjects wearing wide apparel, and even animals. We demonstrate the performance of our approach using several captured real-world sequences, and also validate its accuracy.