Layered construction for deformable animated characters
SIGGRAPH '89 Proceedings of the 16th annual conference on Computer graphics and interactive techniques
Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
IEEE Computer Graphics and Applications - Special issue on computer-aided geometric design
Robust incremental optical flow
Robust incremental optical flow
Realistic modeling for facial animation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Computer facial animation
Video Rewrite: driving visual speech with audio
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Automatic Interpretation and Coding of Face Images Using Flexible Models
IEEE Transactions on Pattern Analysis and Machine Intelligence
A Simple Algorithm for Nearest Neighbor Search in High Dimensions
IEEE Transactions on Pattern Analysis and Machine Intelligence
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Performance-driven hand-drawn animation
NPAR '00 Proceedings of the 1st international symposium on Non-photorealistic animation and rendering
Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Trainable videorealistic speech animation
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Computer generated animation of faces
ACM '72 Proceedings of the ACM annual conference - Volume 1
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models
IEEE Transactions on Pattern Analysis and Machine Intelligence
Hierarchical Model-Based Motion Estimation
ECCV '92 Proceedings of the Second European Conference on Computer Vision
Implicit Probabilistic Models of Human Motion for Synthesis and Tracking
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
A Dynamic Bayesian Network Approach to Tracking Using Learned Switching Dynamic Models
HSCC '00 Proceedings of the Third International Workshop on Hybrid Systems: Computation and Control
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video
CA '96 Proceedings of the Computer Animation
Evaluating Video-Based Motion Capture
CA '02 Proceedings of the Computer Animation
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Robust Full-Motion Recovery of Head by Dynamic Templates and Re-Registration Techniques
FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
A parametric model for human faces.
A parametric model for human faces.
Lucas-Kanade 20 Years On: A Unifying Framework
International Journal of Computer Vision
Design issues for vision-based computer interaction systems
Proceedings of the 2001 workshop on Perceptive user interfaces
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Real-time speech motion synthesis from recorded motions
SCA '04 Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation
Mood swings: expressive speech animation
ACM Transactions on Graphics (TOG)
Automatic determination of facial muscle activations from sparse motion capture marker data
ACM SIGGRAPH 2005 Papers
Face transfer with multilinear models
ACM SIGGRAPH 2005 Papers
Animating blendshape faces by cross-mapping motion capture data
I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
A Closed-Form Solution to Non-Rigid Shape and Motion Recovery
International Journal of Computer Vision
Capturing and animating skin deformation in human motion
ACM SIGGRAPH 2006 Papers
Face transfer with multilinear models
ACM SIGGRAPH 2006 Courses
Transferring of Speech Movements from Video to 3D Face Space
IEEE Transactions on Visualization and Computer Graphics
Facial animation in a nutshell: past, present and future
SAICSIT '06 Proceedings of the 2006 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries
eFASE: expressive facial animation synthesis and editing with phoneme-isomap controls
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Simulating speech with a physics-based facial muscle model
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Dynamic, expressive speech animation from a single mesh
SCA '07 Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation
Face poser: interactive modeling of 3D facial expressions using model priors
SCA '07 Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation
Constraint-based motion optimization using a statistical dynamic model
ACM SIGGRAPH 2007 papers
Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia
High Resolution Tracking of Non-Rigid Motion of Densely Sampled 3D Data Using Harmonic Maps
International Journal of Computer Vision
Feature points based facial animation retargeting
Proceedings of the 2008 ACM symposium on Virtual reality software and technology
Instant Casting Movie Theater: The Future Cast System
IEICE - Transactions on Information and Systems
“Dive into the Movie” Audience-Driven Immersive Experience in the Story
IEICE - Transactions on Information and Systems
Face/Off: live facial puppetry
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Performance driven face animation via non-rigid 3d tracking
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Pose-space animation and transfer of facial details
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Face poser: Interactive modeling of 3D facial expressions using facial priors
ACM Transactions on Graphics (TOG)
Speech-Driven Facial Animation Using a Shared Gaussian Process Latent Variable Model
ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Data-driven animation of crowds
MIRAGE'07 Proceedings of the 3rd international conference on Computer vision/computer graphics collaboration techniques
Real-time face pose tracking and facial expression synthesizing for the animation of 3D avatar
Edutainment'07 Proceedings of the 2nd international conference on Technologies for e-learning and digital entertainment
Low cost virtual face performance capture using stereo web cameras
PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
Dynamic texture synthesis using a spatial temporal descriptor
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Bilinear kernel reduced rank regression for facial expression synthesis
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
Reflecting user faces in avatars
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Automatic generation of head models and facial animations considering personal characteristics
Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology
Gamer's facial cloning for online interactive games
International Journal of Computer Games Technology - Special issue on cyber games and interactive entertainment
Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition
ACM SIGGRAPH 2011 papers
Realtime performance-based facial animation
ACM SIGGRAPH 2011 papers
Human face animation based on video analysis, with applications to mobile entertainment
Journal of Mobile Multimedia
Real-time facial animation from live video tracking
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Instant movie casting with personality: Dive into the movie system
Proceedings of the 2011 international conference on Virtual and mixed reality: systems and applications - Volume Part II
Real-Time expression mapping with ratio image
ICESS'05 Proceedings of the Second international conference on Embedded Software and Systems
Vision based speech animation transferring with underlying anatomical structure
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I
A piece-wise learning approach to 3D facial animation
ICWL'07 Proceedings of the 6th international conference on Advances in web based learning
Video-driven state-aware facial animation
Computer Animation and Virtual Worlds
Facial action transfer with personalized bilinear regression
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Unconventional approaches for facial animation and tracking
SIGGRAPH Asia 2012 Technical Briefs
Dynamic units of visual speech
EUROSCA'12 Proceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation
Dynamic units of visual speech
Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Online modeling for realtime facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
3D shape regression for real-time facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Realtime facial animation with on-the-fly correctives
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Reconstructing detailed dynamic face geometry from monocular video
ACM Transactions on Graphics (TOG)
| Hi-index | 0.00 |
Controlling and animating the facial expression of a computer-generated 3D character is a difficult problem because the face has many degrees of freedom while most available input devices have few. In this paper, we show that a rich set of lifelike facial actions can be created from a preprocessed motion capture database and that a user can control these actions by acting out the desired motions in front of a video camera. We develop a real-time facial tracking system to extract a small set of animation control parameters from video. Because of the nature of video data, these parameters may be noisy, low-resolution, and contain errors. The system uses the knowledge embedded in motion capture data to translate these low-quality 2D animation control signals into high-quality 3D facial expressions. To adapt the synthesized motion to a new character model, we introduce an efficient expression retargeting technique whose run-time computation is constant independent of the complexity of the character model. We demonstrate the power of this approach through two users who control and animate a wide range of 3D facial expressions of different avatars.