Design and evaluation of expressive gesture synthesis for embodied conversational agents

Authors:
B. Hartmann;M. Mancini;S. Buisine;C. Pelachaud
Affiliations:
Stanford University;University of Paris-8;LIMSI-CNRS and LCPI-ENSAM;University of Paris-8
Venue:
Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
Year:
2005

Citing 2
Cited 20

Personality-rich believable agents that use language

AGENTS '97 Proceedings of the first international conference on Autonomous agents
Embodied contextual agent in information delivering application

Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2

Multimodal expressive embodied conversational agents

Proceedings of the 13th annual ACM international conference on Multimedia
Automated generation of non-verbal behavior for virtual embodied characters

Proceedings of the 9th international conference on Multimodal interfaces
Gesture modeling and animation based on a probabilistic re-creation of speaker style

ACM Transactions on Graphics (TOG)
Distinctiveness in multimodal behaviors

Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
Towards Natural Gesture Synthesis: Evaluating Gesture Units in a Data-Driven Approach to Gesture Synthesis

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
The Behavior Markup Language: Recent Developments and Challenges

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Dynamic Behavior Qualifiers for Conversational Agents

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
A Listening Agent Exhibiting Variable Behaviour

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Implementing Distinctive Behavior for Conversational Agents

Gesture-Based Human-Computer Interaction and Simulation
Studies on gesture expressivity for a virtual agent

Speech Communication
A Parameter-Based Model for Generating Culturally Adaptive Nonverbal Behaviors in Embodied Conversational Agents

UAHCI '09 Proceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments
A Model of Personality and Emotional Traits

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Automatic temporal segment detection and affect recognition from face and body display

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
Gesture based dialogue management using behavior network for flexibility of human robot interaction

CIRA'09 Proceedings of the 8th IEEE international conference on Computational intelligence in robotics and automation
Challenges for virtual humans in human computing

ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Evaluating the communication of emotion via expressive gesture copying behaviour in an embodied humanoid agent

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Creativity meets automation: combining nonverbal action authoring with rules and machine learning

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Evaluating the tangible interface and virtual characters in the interactive COHIBIT exhibit

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Synthesizing mood-affected signed messages: Modifications to the parametric synthesis

International Journal of Human-Computer Studies
Multimodal sensing, interpretation and copying of movements by a virtual agent

PIT'06 Proceedings of the 2006 international tutorial and research conference on Perception and Interactive Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

To increase the believability and life-likeness of Embodied Conversational Agents (ECAs), we introduce a behavior synthesis technique for the generation of expressive gesturing. A small set of dimensions of expressivity is used to characterize individual variability of movement. We empirically evaluate our implementation in two separate user studies. The results suggest that our approach works well for a subset of expressive behavior. However, animation fidelity is not high enough to realize subtle changes. Interaction effects between different parameters need to be studied further.