Coding, Analysis, Interpretation, and Recognition of Facial Expressions
IEEE Transactions on Pattern Analysis and Machine Intelligence
A real time anatomical converter for human motion capture
Proceedings of the Eurographics workshop on Computer animation and simulation '96
A survey of computer vision-based human motion capture
Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
IEEE Transactions on Pattern Analysis and Machine Intelligence
Modelling with implicit surfaces that interpolate
ACM Transactions on Graphics (TOG)
3-D Motion Estimation in Model-Based Facial Image Coding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Evaluating Video-Based Motion Capture
CA '02 Proceedings of the Computer Animation
Multiple Cues used in Model-Based Human Motion Capture
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Mixed scale motion recovery
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Automatic determination of facial muscle activations from sparse motion capture marker data
ACM SIGGRAPH 2005 Papers
A Closed-Form Solution to Non-Rigid Shape and Motion Recovery
International Journal of Computer Vision
Capturing and animating skin deformation in human motion
ACM SIGGRAPH 2006 Papers
A ball tracking framework for broadcast soccer video
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 1
Estimation of missing markers in human motion capture
The Visual Computer: International Journal of Computer Graphics
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
A survey of advances in vision-based human motion capture and analysis
Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Articulated motion reconstruction from feature points
Pattern Recognition
Nonrigid Structure-from-Motion: Estimating Shape and Motion with Hierarchical Priors
IEEE Transactions on Pattern Analysis and Machine Intelligence
Predicting Missing Markers to Drive Real-Time Centre of Rotation Estimation
AMDO '08 Proceedings of the 5th international conference on Articulated Motion and Deformable Objects
| Hi-index | 0.00 |
For the existing motion capture (MoCap) data processing methods, manual interventions are always inevitable, most of which are derived from the data tracking process. This paper addresses the problem of tracking non-rigid 3D facial motions from sequences of raw MoCap data in the presence of noise, outliers and long time missing. We present a novel dynamic spatiotemporal framework to automatically solve the problem. First, based on a 3D facial topological structure, a sophisticated non-rigid motion interpreter (SNRMI) is put forward; together with a dynamic searching scheme, it cannot only track the non-missing data to the maximum extent but recover missing data (it can accurately recover more than five adjacent markers under long time (about 5 seconds) missing) accurately. To rule out wrong tracks of the markers labeled in open structures (such as mouth, eyes), a semantic-based heuristic checking method was raised. Second, since the existing methods have not taken the noise propagation problem into account, a forward processing framework is presented to solve the problem. Another contribution is the proposed method could track facial non-rigid motions automatically and forward, and is believed to greatly reduce even eliminate the requirements of human interventions during the facial MoCap data processing. Experimental results proved the effectiveness, robustness and accuracy of our system.