A speech-driven embodied entrainment wall picture system for supporting virtual communication

Authors:
Yoshihiro Sejima;Tomio Watanabe
Affiliations:
Okayama Prefectural University, Soja, Okayama, Japan;Okayama Prefectural University, Soja, Okayama, Japan
Venue:
Proceedings of the 3rd International Universal Communication Symposium
Year:
2009

Citing 2
Cited 1

Visual models of plants interacting with their environment

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Analysis by Synthesis of Embodied Communication via VirtualActor with a Nodding Response Model

ISUC '08 Proceedings of the 2008 Second International Symposium on Universal Communication

A virtual audience system for enhancing embodied interaction based on conversational activity

HCII'11 Proceedings of the 1st international conference on Human interface and the management of information: interacting with information - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have developed a speech-driven embodied entrainment system called "InterPicture" and have demonstrated the effectiveness of the system using an embodied virtual communication system. InterPicture is an image containing flowers that react to the speech input of talkers. We confirmed the importance of providing a communication environment in which not only avatars but also CG objects placed around the avatars are related to virtual communication. In this study, we have developed an advanced speech-driven embodied entrainment system called "InterWall". This system projects wall picture widely onto the wall surrounding avatars and behaves as a listener by producing nodding and body movements on the basis of the speech input of a talker. Further, a communication experiment has been performed, and the effectiveness of "InterWall" has been demonstrated by carrying out a sensory evaluation and a speech-overlap analysis for 20 pairs of 40 talkers.