An NVC emotional model for conversational virtual humans in a 3d chatting environment

Authors:
Junghyun Ahn;Stéphane Gobron;David Garcia;Quentin Silvestre;Daniel Thalmann;Ronan Boulic
Affiliations:
Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland;Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland, Information and Communication Systems (ISIC), HE-Arc, St-Imier, Switzerland;Chair of Systems Design (CSD), ETHZ, Zurich, Switzerland;Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland;Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland, Institute for Media Innovation (IMI), NTU, Singapore;Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland
Venue:
AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
Year:
2012

Citing 13
Cited 1

Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
BEAT: the Behavior Expression Animation Toolkit

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Brownian Agents and Active Particles: Collective Dynamics in the Natural and Social Sciences

Brownian Agents and Active Particles: Collective Dynamics in the Natural and Social Sciences
A conversational agent as museum guide: design and evaluation of a real-world application

Lecture Notes in Computer Science
Handbook of Virtual Humans

Handbook of Virtual Humans
IDEAS4Games: Building Expressive Virtual Characters for Computer Games

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Coming of Age in Second Life: An Anthropologist Explores the Virtually Human

Coming of Age in Second Life: An Anthropologist Explores the Virtually Human
Studies on gesture expressivity for a virtual agent

Speech Communication
Ada and grace: toward realistic and engaging virtual museum guides

IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Smile When You Read This, Whether You Like It or Not: Conceptual Challenges to Affect Detection

IEEE Transactions on Affective Computing
Constraint-Based Model for Synthesis of Multimodal Sequential Expressions of Emotions

IEEE Transactions on Affective Computing
An event-based architecture to manage virtual human non-verbal communication in 3d chatting environment

AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
An interdisciplinary VR-architecture for 3D chatting with non-verbal communication

EGVE - JVRC'11 Proceedings of the 17th Eurographics conference on Virtual Environments & Third Joint Virtual Reality

An event-based architecture to manage virtual human non-verbal communication in 3d chatting environment

AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a new emotional model for Virtual Humans (VHs) in a conversational environment. As a part of a multi-users emotional 3D-chatting system, this paper focus on how to formulate and visualize the flow of emotional state defined by the Valence-Arousal-Dominance (VAD) parameters. From this flow of emotion over time, we successfully visualized the change of VHs' emotional state through the proposed emoFaces and emoMotions. The notion of Non-Verbal Communication (NVC) was exploited for driving plausible emotional expressions during conversation. With the help of a proposed interface, where a user can parameterize emotional state and flow, we succeeded to vary the emotional expressions and reactions of VHs in a 3D conversation scene.