High-quality passive facial performance capture using anchor frames
ACM SIGGRAPH 2011 papers
Cooperative patch-based 3D surface tracking
CVMP '11 Proceedings of the 2011 Conference for Visual Media Production
Global Non-rigid Alignment of Surface Sequences
International Journal of Computer Vision
| Hi-index | 0.00 |
The 3D capture of facial performance has become a necessary tool for delivering visual effects related to an actor's face or for creating new realistic characters. We present a novel system using a practical acquisition setup without active illumination or high-speed recording. Non-sequential surface tracking based on the minimum spanning tree is introduced for the facial performance application. This optimal traversal through the sequence is combined with a frame-to-frame alignment method which is robust against weak texture and fast non-rigid motions. Photometric stereo based on colour illumination reconstructs metrically correct normals of fine skin geometry. The resulting 3D model consists of the temporally consistent mesh sequence combined with high-detail UV normal maps.