Speech-driven embodied entrainment character system with hand motion input in mobile environment

Authors:
Kouzi Osaki;Tomio Watanabe;Michiya Yamamoto
Affiliations:
Okayama Prefectural University, Soja Okayama, Japan;Okayama Prefectural University, Soja Okayama, Japan;Okayama Prefectural University, Soja Okayama, Japan
Venue:
Proceedings of the 9th international conference on Multimodal interfaces
Year:
2007

Citing 2
Cited 1

Sympathetic interfaces: using a plush toy to direct synthetic characters

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
HandySinger: expressive singing voice morphing using personified hand-puppet interface

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression

Development of a context-enhancing surface based on the entrainment of embodied rhythms and actions sharing via interaction

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

InterActor is a speech-input-driven CG-embodied interaction character that can generate communicative movements and actions for entrained interactions. InterPuppet, on the other hand, is an embodied interaction character that is driven by both speech input-similar to InterActor-and hand motion input, like a puppet. Therefore, humans can use InterPuppet to effectively communicate by using deliberate body movements and natural communicative movements and actions. In this paper, an advanced InterPuppet system that uses a cellular-phone-type device is developed, which can be used in a mobile environment. The effectiveness of the system is demonstrated by performing a sensory evaluation experiment in an actual remote communication scenario.