An event-based architecture to manage virtual human non-verbal communication in 3d chatting environment

Authors:
Stéphane Gobron;Junghyun Ahn;David Garcia;Quentin Silvestre;Daniel Thalmann;Ronan Boulic
Affiliations:
Information and Communication Systems Institute (ISIC), HE-Arc, St-Imier, Switzerland, Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland;Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland;Chair of Systems Design (CSD), ETHZ, Zurich, Switzerland;Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland;Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland, Institute for Media Innovation (IMI), NTU, Singapore;Immersive Interaction Group (IIG), EPFL, Lausanne, Switzerland
Venue:
AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
Year:
2012

Citing 11
Cited 2

BEAT: the Behavior Expression Animation Toolkit

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
A Model of Nonverbal Communication and Interpersonal Relationship Between Virtual Actors

CA '96 Proceedings of the Computer Animation
A conversational agent as museum guide: design and evaluation of a real-world application

Lecture Notes in Computer Science
The Effects of an Embodied Conversational Agent's Nonverbal Behavior on User's Evaluation and Behavioral Mimicry

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Coming of Age in Second Life: An Anthropologist Explores the Virtually Human

Coming of Age in Second Life: An Anthropologist Explores the Virtually Human
Studies on gesture expressivity for a virtual agent

Speech Communication
Expression of Moral Emotions in Cooperating Agents

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Smile When You Read This, Whether You Like It or Not: Conceptual Challenges to Affect Detection

IEEE Transactions on Affective Computing
Constraint-Based Model for Synthesis of Multimodal Sequential Expressions of Emotions

IEEE Transactions on Affective Computing
An NVC emotional model for conversational virtual humans in a 3d chatting environment

AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
An interdisciplinary VR-architecture for 3D chatting with non-verbal communication

EGVE - JVRC'11 Proceedings of the 17th Eurographics conference on Virtual Environments & Third Joint Virtual Reality

An NVC emotional model for conversational virtual humans in a 3d chatting environment

AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
Human-virtual human interaction by upper body gesture understanding

Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Non-verbal communication (NVC) makes up about two-thirds of all communication between two people or between one speaker and a group of listeners. However, this fundamental aspect of communicating is mostly omitted in 3D social forums or virtual world oriented games. This paper proposes an answer by presenting a multi-user 3D-chatting system enriched with NVC relative to motion. This event-based architecture tries to recreate a context by extracting emotional cues from dialogs and derives virtual human potential body expressions from that event triggered context model. We structure the paper by expounding the system architecture enabling the modeling NVC in a multi-user 3D-chatting environment. There, we present the transition from dialog-based emotional cues to body language, and the management of NVC events in the context of a virtual reality client-server system. Finally, we illustrate the results with graphical scenes and a statistical analysis representing the increase of events due to NVC.