SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Improv: a system for scripting interactive actors in virtual worlds
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Video Rewrite: driving visual speech with audio
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Layered compositing of facial expression
ACM SIGGRAPH 97 Visual Proceedings: The art and interdisciplinary programs of SIGGRAPH '97
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Animating rotation with quaternion curves
SIGGRAPH '85 Proceedings of the 12th annual conference on Computer graphics and interactive techniques
Embodied conversational interface agents
Communications of the ACM
The effect of communication modality on cooperation in online environments
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
BEAT: the Behavior Expression Animation Toolkit
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Trainable videorealistic speech animation
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Motion texture: a two-level statistical model for character motion synthesis
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Interactive motion generation from examples
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Interactive control of avatars animated with human motion data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Automated Derivation of Primitives for Movement Classification
Autonomous Robots
Formational Parameters and Adaptive Prototype Instantiation for MPEG-4 Compliant Gesture Synthesis
CA '02 Proceedings of the Computer Animation
Segmenting motion capture data into distinct behaviors
GI '04 Proceedings of the 2004 Graphics Interface Conference
Mood swings: expressive speech animation
ACM Transactions on Graphics (TOG)
Synthesizing multimodal utterances for conversational agents: Research Articles
Computer Animation and Virtual Worlds
Efficient content-based retrieval of motion capture data
ACM SIGGRAPH 2005 Papers
Simulating speech with a physics-based facial muscle model
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Automatic splicing for hand and body animations
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Head gestures for perceptual interfaces: The role of context in improving recognition
Artificial Intelligence
Near-optimal character animation with continuous control
ACM SIGGRAPH 2007 papers
Synthesis and evaluation of linear motion transitions
ACM Transactions on Graphics (TOG)
Gesture modeling and animation based on a probabilistic re-creation of speaker style
ACM Transactions on Graphics (TOG)
Learning dynamic audio-visual mapping with input-output Hidden Markov models
IEEE Transactions on Multimedia
Seeing is believing: body motion dominates in multisensory conversations
ACM SIGGRAPH 2010 papers
ACM SIGGRAPH 2010 papers
Evaluating the effect of gesture and language on personality perception in conversational agents
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
On creating multimodal virtual humans--real time speech driven facial gesturing
Multimedia Tools and Applications
How to train your avatar: a data driven approach to gesture generation
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
Examining the role of gestures in expert tutoring
ITS'10 Proceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part I
Animating synthetic dyadic conversations with variations based on context and agent attributes
Computer Animation and Virtual Worlds
Data-driven finger motion synthesis for gesturing characters
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Gesture unit segmentation using support vector machines: segmenting gestures from rest positions
Proceedings of the 28th Annual ACM Symposium on Applied Computing
Virtual character performance from speech
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Towards higher quality character performance in previz
Proceedings of the Symposium on Digital Production
Gesture synthesis adapted to speech emphasis
Speech Communication
Hi-index | 0.00 |
Human communication involves not only speech, but also a wide variety of gestures and body motions. Interactions in virtual environments often lack this multi-modal aspect of communication. We present a method for automatically synthesizing body language animations directly from the participants' speech signals, without the need for additional input. Our system generates appropriate body language animations by selecting segments from motion capture data of real people in conversation. The synthesis can be performed progressively, with no advance knowledge of the utterance, making the system suitable for animating characters from live human speech. The selection is driven by a hidden Markov model and uses prosody-based features extracted from speech. The training phase is fully automatic and does not require hand-labeling of input data, and the synthesis phase is efficient enough to run in real time on live microphone input. User studies confirm that our method is able to produce realistic and compelling body language.