Multi-level partition of unity implicits
ACM SIGGRAPH 2003 Papers
Realistic human face rendering for "The Matrix Reloaded"
ACM SIGGRAPH 2003 Sketches & Applications
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
An intuitive framework for real-time freeform modeling
ACM SIGGRAPH 2004 Papers
A Hierarchical Framework For High Resolution Facial Expression Tracking
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 1 - Volume 01
Poisson surface reconstruction
SGP '06 Proceedings of the fourth Eurographics symposium on Geometry processing
Reconstruction of deforming geometry from time-varying point clouds
SGP '07 Proceedings of the fifth Eurographics symposium on Geometry processing
On Linear Variational Surface Deformation Methods
IEEE Transactions on Visualization and Computer Graphics
Towards building a 4D morphable face model
Proceedings of the SSPNET 2nd International Symposium on Facial Analysis and Animation
High-resolution object deformation reconstruction with active range camera
Proceedings of the 32nd DAGM conference on Pattern recognition
| Hi-index | 0.00 |
We present a novel algorithm for the markerless tracking of deforming surfaces such as faces. We acquire a sequence of 3D scans along with color images at 40Hz. The data is then represented by implicit surface and color functions, using a novel partition-of-unity type method of efficiently combining local regressors using nearest neighbor searches. Both these functions act on the 4D space of 3D plus time, and use temporal information to handle the noise in individual scans. After interactive registration of a template mesh to the first frame, it is then automatically deformed to track the scanned surface, using the variation of both shape and color as features in a dynamic energy minimization problem. Our prototype system yields high-quality animated 3D models in correspondence, at a rate of approximately twenty seconds per timestep. Tracking results for faces and other objects are presented.