Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Improv: a system for scripting interactive actors in virtual worlds
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Retargetting motion to new characters
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Physically based motion transformation
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Building natural language generation systems
Building natural language generation systems
Embodied conversational interface agents
Communications of the ACM
The EMOTE model for effort and shape
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
BEAT: the Behavior Expression Animation Toolkit
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Footskate cleanup for motion capture editing
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
On-line locomotion generation based on motion blending
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
Introduction to Automata Theory, Languages and Computability
Introduction to Automata Theory, Languages and Computability
Trainable videorealistic speech animation
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Motion texture: a two-level statistical model for character motion synthesis
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Interactive motion generation from examples
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Interactive control of avatars animated with human motion data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Motion capture assisted animation: texturing and synthesis
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Verbs and Adverbs: Multidimensional Motion Interpolation
IEEE Computer Graphics and Applications
Making Discours Visible: Coding and Animating Conversational Facial Displays
CA '02 Proceedings of the Computer Animation
Crafting the Illusion of Meaning: Template-Based Specification of Embodied Conversational Behavior
CASA '03 Proceedings of the 16th International Conference on Computer Animation and Social Agents (CASA 2003)
Flexible automatic motion blending with registration curves
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Rhythmic-motion synthesis based on motion-beat analysis
ACM SIGGRAPH 2003 Papers
Motion synthesis from annotations
ACM SIGGRAPH 2003 Papers
Perceptual metrics for character animation: sensitivity to errors in ballistic motion
ACM SIGGRAPH 2003 Papers
From data to speech: a general approach
Natural Language Engineering
Forest-based statistical sentence generation
NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
Exploiting a probabilistic hierarchical model for generation
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Synthesizing multimodal utterances for conversational agents: Research Articles
Computer Animation and Virtual Worlds
Unit selection in a concatenative speech synthesis system using a large speech database
ICASSP '96 Proceedings of the Acoustics, Speech, and Signal Processing, 1996. on Conference Proceedings., 1996 IEEE International Conference - Volume 01
Factored A* search for models over sequences and trees
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Current and New Directions in Discourse and Dialogue
Computational Linguistics
Motion patches: building blocks for virtual environments annotated with motion data
ACM SIGGRAPH 2006 Papers
Describing and generating multimodal contents featuring affective lifelike agents with MPML
New Generation Computing
Computational studies of human motion: part 1, tracking and motion synthesis
Foundations and Trends® in Computer Graphics and Vision
Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology
Learning to say it well: reranking realizations by predicted synthesis quality
ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Synchronized background music generation for video
Proceedings of the international conference on Advances in computer entertainment technology
Personality and Emotion-Based High-Level Control of Affective Story Characters
IEEE Transactions on Visualization and Computer Graphics
Assembling an expressive facial animation system
Proceedings of the 2007 ACM SIGGRAPH symposium on Video games
Evaluating motion graphs for character animation
ACM Transactions on Graphics (TOG)
Gesture modeling and animation based on a probabilistic re-creation of speaker style
ACM Transactions on Graphics (TOG)
SmartBody: behavior realization for embodied conversational agents
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Characterizing Emotion in the Soundtrack of an Animated Film: Credible or Incredible?
ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Studies on gesture expressivity for a virtual agent
Speech Communication
Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
Generating Believable Personality-Rich Story Characters Using Body Languages
Proceedings of the 2006 conference on Advances in Intelligent IT: Active Media Technology 2006
Comparing rule-based and data-driven selection of facial displays
EmbodiedNLP '07 Proceedings of the Workshop on Embodied Language Processing
Avoiding repetition in generated text
ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
GNetIc --- Using Bayesian Decision Networks for Iconic Gesture Generation
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
EMBR --- A Realtime Animation Engine for Interactive Embodied Agents
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Augmenting Gesture Animation with Motion Capture Data to Provide Full-Body Engagement
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Distributed Episode Control System for Interactive Narrative Entertainment
ICEC '09 Proceedings of the 8th International Conference on Entertainment Computing
Real-time prosody-driven synthesis of body language
ACM SIGGRAPH Asia 2009 papers
Associating facial displays with syntactic constituents for generation
LAW '07 Proceedings of the Linguistic Annotation Workshop
Language, embodiment and social intelligence
INLG '08 Proceedings of the Fifth International Natural Language Generation Conference
Practical grammar-based NLG from examples
INLG '08 Proceedings of the Fifth International Natural Language Generation Conference
Conversational gestures in human-robot interaction
SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
ACM SIGGRAPH 2010 papers
From annotated multimodal corpora to simulated human-like behaviors
ZiF'06 Proceedings of the Embodied communication in humans and machines, 2nd ZiF research group international conference on Modeling communication with robots and virtual humans
The perception of finger motions
Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization
User Modeling and User-Adapted Interaction
Interactive motion modeling and parameterization by direct demonstration
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Multimodal behavior realization for embodied conversational agents
Multimedia Tools and Applications
ACM Transactions on Interactive Intelligent Systems (TiiS)
How to train your avatar: a data driven approach to gesture generation
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
Requirements for a gesture specification language: a comparison of two representation formalisms
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Data-driven finger motion synthesis for gesturing characters
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Human-computer dance interaction with realtime accelerometer control
Proceedings of the 20th ACM international conference on Multimedia
Immersive interfaces for building parameterized motion databases
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
Virtual character performance from speech
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Guest Editorial: Gesture and speech in interaction: An overview
Speech Communication
Gesture synthesis adapted to speech emphasis
Speech Communication
Intelligent virtual humans with autonomy and personality: State-of-the-art
Intelligent Decision Technologies
| Hi-index | 0.00 |
We describe a method for using a database of recorded speech and captured motion to create an animated conversational character. People's utterances are composed of short, clearly-delimited phrases; in each phrase, gesture and speech go together meaningfully and synchronize at a common point of maximum emphasis. We develop tools for collecting and managing performance data that exploit this structure. The tools help create scripts for performers, help annotate and segment performance data, and structure specific messages for characters to use within application contexts. Our animations then reproduce this structure. They recombine motion samples with new speech samples to recreate coherent phrases, and blend segments of speech and motion together phrase-by-phrase into extended utterances. By framing problems for utterance generation and synthesis so that they can draw closely on a talented performance, our techniques support the rapid construction of animated characters with rich and appropriate expression.