An example-based approach for facial expression cloning

Authors:
Hyewon Pyun;Yejin Kim;Wonseok Chae;Hyung Woo Kang;Sung Yong Shin
Affiliations:
Korea Advanced Institute of Science and Technology;Electronics and Telecommunications Research Institute;Korea Advanced Institute of Science and Technology;Korea Advanced Institute of Science and Technology;Korea Advanced Institute of Science and Technology
Venue:
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Year:
2003

Citing 21
Cited 41

A muscle model for animation three-dimensional facial expression

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Performance-driven facial animation

SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Realistic modeling for facial animation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Computer facial animation

Computer facial animation
Retargetting motion to new characters

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Making faces

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Physically based motion transformation

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A hierarchical approach to interactive motion editing for human-like figures

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Performance-driven hand-drawn animation

NPAR '00 Proceedings of the 1st international symposium on Non-photorealistic animation and rendering
Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Fast texture synthesis using tree-structured vector quantization

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Shape by example

I3D '01 Proceedings of the 2001 symposium on Interactive 3D graphics
Expression cloning

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
On-line locomotion generation based on motion blending

Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Turning to the masters: motion capturing cartoons

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Articulated body deformation from range scan data

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Verbs and Adverbs: Multidimensional Motion Interpolation

IEEE Computer Graphics and Applications
Real-Time Facial Animation based upon a Bank of 3D Facial Expressions

CA '98 Proceedings of the Computer Animation
Animating facial expressions

SIGGRAPH '81 Proceedings of the 8th annual conference on Computer graphics and interactive techniques

Animal gaits from video

SCA '04 Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation
Mood swings: expressive speech animation

ACM Transactions on Graphics (TOG)
Automatic determination of facial muscle activations from sparse motion capture marker data

ACM SIGGRAPH 2005 Papers
Expressive speech-driven facial animation

ACM Transactions on Graphics (TOG)
Geometry-Driven Photorealistic Facial Expression Synthesis

IEEE Transactions on Visualization and Computer Graphics
Fast individual face modeling and animation

Proceedings of the second Australasian conference on Interactive entertainment
Animating blendshape faces by cross-mapping motion capture data

I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Animal gaits from video: comparative studies

Graphical Models - Special issue on SCA 2004
Modeling and animating for the dense laser-scanned face in the low resolution level

MS'06 Proceedings of the 17th IASTED international conference on Modelling and simulation
Expressive Facial Animation Synthesis by Learning Speech Coarticulation and Expression Spaces

IEEE Transactions on Visualization and Computer Graphics
Facial motion retargeting

ACM SIGGRAPH 2006 Courses
Transferring of Speech Movements from Video to 3D Face Space

IEEE Transactions on Visualization and Computer Graphics
eFASE: expressive facial animation synthesis and editing with phoneme-isomap controls

Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Simulating speech with a physics-based facial muscle model

Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Intuitive quasi-eigen faces

Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia
Technology and Digital Art: 3D scan-based animation techniques for Chinese opera facial expression documentation

Computers and Graphics
Interactive 3D facial expression posing through 2D portrait manipulation

GI '08 Proceedings of graphics interface 2008
Feature points based facial animation retargeting

Proceedings of the 2008 ACM symposium on Virtual reality software and technology
EDFCES: a new example-driven 3D face construction and editing system

Machine Graphics & Vision International Journal
An extensible framework for interactive facial animation with facial expressions, lip synchronization and eye behavior

Computers in Entertainment (CIE) - SPECIAL ISSUE: Games
A facial expression parameterization by elastic surface model

International Journal of Computer Games Technology
Example-based performance driven facial shape animation

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
3D facial expression editing based on the dynamic graph model

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Multimedia authoring tool for real-time facial animation

MCAM'07 Proceedings of the 2007 international conference on Multimedia content analysis and mining
Automatic 3D facial model and texture reconstruction from range scans

AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
Bilinear kernel reduced rank regression for facial expression synthesis

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
Expression transfer for facial sketch animation

Signal Processing
Content retargeting using parameter-parallel facial layers

SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Artist friendly facial animation retargeting

Proceedings of the 2011 SIGGRAPH Asia Conference
On the use of 3d scanner for chinese opera documentation

VSMM'06 Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical Systems
Real-Time facial expression mapping for high resolution 3d meshes

CGI'06 Proceedings of the 24th international conference on Advances in Computer Graphics
Automatic 3d facial expression analysis in videos

AMFG'05 Proceedings of the Second international conference on Analysis and Modelling of Faces and Gestures
3D game engine for real-time facial animation

AI'05 Proceedings of the 18th Australian Joint conference on Advances in Artificial Intelligence
Vision based speech animation transferring with underlying anatomical structure

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I
A multiresolutional approach for facial motion retargetting using subdivision wavelets

ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part II
Spacetime expression cloning for blendshapes

ACM Transactions on Graphics (TOG)
Data-driven facial expression synthesis via Laplacian deformation

Multimedia Tools and Applications
A realistic dynamic facial expression transfer method

Neurocomputing
Two dimensional synthetic face generation and verification using set estimation technique

Computer Vision and Image Understanding
Online expression mapping for performance-driven facial animation

ICEC'07 Proceedings of the 6th international conference on Entertainment Computing
3D facial expression synthesis from a single image using a model set

ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present a novel example-based approach for cloning facial expressions of a source model to a target model while reflecting the characteristic features of the target model in the resulting animation. Our approach comprises three major parts: key-model construction, parameterization, and expression blending. We first present an effective scheme for constructing key-models. Given a set of source example key-models and their corresponding target key-models created by animators, we parameterize the target key-models using the source key-models and predefine the weight functions for the parameterized target key-models based on radial basis functions. In runtime, given an input model with some facial expression, we compute the parameter vector of the corresponding output model, to evaluate the weight values for the target key-models and obtain the output model by blending the target key-models with those weights. The resulting animation preserves the facial expressions of the input model as well as the characteristic features of the target model specified by animators. Our method is not only simple and accurate but also fast enough for various real-time applications such as video games or internet broadcasting.