Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Joint-dependent local deformations for hand animation and object grasping
Proceedings on Graphics interface '88
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Animated deformations with radial basis functions
VRST '00 Proceedings of the ACM symposium on Virtual reality software and technology
Articulated body deformation from range scan data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Computer generated animation of faces
ACM '72 Proceedings of the ACM annual conference - Volume 1
Vision-based control of 3D facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Active Appearance Models Revisited
International Journal of Computer Vision
Modeling deformable human hands from medical images
SCA '04 Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation
Reducing blendshape interference by selected motion attenuation
Proceedings of the 2005 symposium on Interactive 3D graphics and games
Fast exact and approximate geodesics on meshes
ACM SIGGRAPH 2005 Papers
Animating blendshape faces by cross-mapping motion capture data
I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Performance-driven facial animation
ACM SIGGRAPH 2006 Courses
Learning controls for blend shape based realistic facial animation
ACM SIGGRAPH 2006 Courses
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Real-time data driven deformation using kernel canonical correlation analysis
ACM SIGGRAPH 2008 papers
Facial performance synthesis using deformation-driven polynomial displacement maps
ACM SIGGRAPH Asia 2008 papers
Face/Off: live facial puppetry
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
An iterative image registration technique with an application to stereo vision
IJCAI'81 Proceedings of the 7th international joint conference on Artificial intelligence - Volume 2
Pose-space animation and transfer of facial details
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
ACM SIGGRAPH 2010 papers
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
On Appearance Based Face and Facial Action Tracking
IEEE Transactions on Circuits and Systems for Video Technology
Video-driven state-aware facial animation
Computer Animation and Virtual Worlds
Connecting users to virtual worlds within MPEG-V standardization
Image Communication
| Hi-index | 0.00 |
This paper describes a complete pipe-line of a practical system for producing real-time facial expressions of a 3D virtual avatar controlled by an actor's live performances. The system handles practical challenges arising from markerless expression captures from a single conventional video camera. For robust tracking, a localized algorithm constrained by belief propagation is applied to the upper face, and an appearance matching technique using a parameterized generic face model is exploited for lower face and head pose tracking. The captured expression features then transferred to high dimensional 3D animation controls using our facial expression space which is a structure-preserving map between two algebraic structures. The transferred animation controls drive facial animation of a 3D avatar while optimizing the smoothness of the face mesh. An example-based face deformation technique produces non-linear local detail deformations on the avatar that are not captured in the movement of the animation controls.