MM+Space: n x 4 degree-of-freedom kinetic display for recreating multiparty conversation spaces

Authors:
Kazuhiro Otsuka;Shiro Kumano;Ryo Ishii;Maja Zbogar;Junji Yamato
Affiliations:
NTT, Atsugi-shi, Japan;NTT, Atsugi-shi, Japan;NTT, Atsugi-shi, Japan;NTT, Atsugi-shi, Japan;NTT, Atsugi-shi, Japan
Venue:
Proceedings of the 15th ACM on International conference on multimodal interaction
Year:
2013

Citing 7
Cited 0

Speech patterns in video-mediated conversations

CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-time Visual Tracker by Stream Processing

Journal of Signal Processing Systems
Exploring use cases for telepresence robots

Proceedings of the 6th international conference on Human-robot interaction
A system for reconstructing multiparty conversation field based on augmented head motion by dynamic projection

MM '11 Proceedings of the 19th ACM international conference on Multimedia
TeleHuman: effects of 3d perspective on gaze and pose estimation with a life-size cylindrical telepresence pod

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SphereAvatar: a situated display to represent a remote collaborator

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Reconstructing multiparty conversation field by augmenting human head motions via dynamic displays

CHI '12 Extended Abstracts on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

A novel system, called MM+Space, is presented for recreating multiparty face-to-face conversation scenes in the real world. It aims to display and playback pre-recorded conversations as if the people were talking in front of the viewer(s). This system consists of multiple projectors and transparent screens, which display the life-size faces of people. The key idea is the physical augmentation of human head motions, i.e. the screen pose is dynamically controlled to emulate the head motions, for boosting the viewers' perception of nonverbal behaviors and interactions. In particular, MM+Space newly introduces 2-Degree-of-Freedom (DoF) translations, in forward-backward and right-left directions, in addition to 2-DoF head rotations (nodding and shaking), which were proposed in our former MM-Space system. The full 4-DoF kinetic display is expected to enhance the expressibility of head and body motions, and to create more realistic representation of interacting people. Experiments showed that the proposed system with 4-DoF motions outperformed the rotation-only system in the increased perception of people's presence and in expressing their postures. In addition, it was reported that the proposed system allowed the viewers to experience rich emotional expressibility, immersion in conversations, and potential behavioral/emotional contagion.