Readings in computer vision: issues, problems, principles, and paradigms
A muscle model for animation three-dimensional facial expression
SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Head shop: generating animated head models with anatomical structure
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Determining Optical Flow
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Deformation transfer for triangle meshes
ACM SIGGRAPH 2004 Papers
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
A remeshing approach to multiresolution modeling
Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing
Automatic determination of facial muscle activations from sparse motion capture marker data
ACM SIGGRAPH 2005 Papers
Face transfer with multilinear models
ACM SIGGRAPH 2005 Papers
Multi-View AAM Fitting and Camera Calibration
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Semantic 3D motion retargeting for facial animation
APGV '06 Proceedings of the 3rd symposium on Applied perception in graphics and visualization
Universal capture - image-based facial animation for "The Matrix Reloaded"
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Harmonic coordinates for character articulation
ACM SIGGRAPH 2007 papers
Multi-scale 3D scene flow from binocular stereo sequences
Computer Vision and Image Understanding
ACM SIGGRAPH 2008 papers
Facial performance synthesis using deformation-driven polynomial displacement maps
ACM SIGGRAPH Asia 2008 papers
Variational harmonic maps for space deformation
ACM SIGGRAPH 2009 papers
Face/Off: live facial puppetry
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
Real-time recovery of moving 3D faces for emerging applications
Computers in Industry
| Hi-index | 0.00 |
In this paper we combine methods from the field of computer vision with surface editing techniques to generate animated faces, which are all in full correspondence to each other. The inputs for our system are synchronized video streams from multiple cameras. The system produces a sequence of triangle meshes with fixed connectivity, representing the dynamics of the captured face. By carefully taking all requirements and characteristics into account we decided for the proposed system design: We deform an initial face template using movements estimated from the video streams. To increase the robustness of the reconstruction, we use a morphable model as a shape prior to initialize a surfel fitting technique which is able to precisely capture face shapes not included in the morphable model. In the deformation stage, we use a 2D mesh based tracking approach to establish correspondences over time. We then reconstruct positions in 3D using the same surfel fitting technique, and finally use the reconstructed points to robustly deform the initially reconstructed face. We demonstrate the applicability of the tracked face template for automatic modeling and show how to use deformation transfer to attenuate expressions, blend expressions or how to build a statistical model, similar to a morphable model, on the dynamic movements.