A system for reconstructing multiparty conversation field based on augmented head motion by dynamic projection

  • Authors:
  • Kazuhiro Otsuka;Kamil Sebastian Mucha;Shiro Kumano;Dan Mikami;Masafumi Matsuda;Junji Yamato

  • Affiliations:
  • NTT Communication Science Laboratories, Atsugi-shi, Japan;NTT Communication Science Laboratories, Atsugi-shi, Japan;NTT Communication Science Laboratories, Atsugi-shi, Japan;NTT Communication Science Laboratories, Atsugi-shi, Japan;NTT Communication Science Laboratories, Atsugi-shi, Japan;NTT Communication Science Laboratories, Atsugi-shi, Japan

  • Venue:
  • MM '11 Proceedings of the 19th ACM international conference on Multimedia
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

A novel system is presented for reconstructing, in the real world, multiparty face-to-face conversation scenes; it uses dynamics projection to augment human head motion. This system aims to display and playback pre-recorded conversations to the viewers as if the remote people were taking in front of them. This system consists of multiple projectors and transparent screens. Each screen separately displays the life-size face of one meeting participant, and are spatially arranged to recreate the actual scene. The main feature of this system is dynamics projection, screen pose is dynamically controlled to emulate the head motions of the participants, especially rotation around the vertical axis, that are typical of shifts in visual attention, i.e. turning gaze from one to another. This recreation of head motion by physical screen motion, in addition to image motion, aims to more clearly express the interactions involving visual attention among the participants. The minimal design, frameless-projector-screen, with augmented head motion is expected to create a feeling that the remote participants are actually present in the same room. This demo presents our initial system and discusses its potential impact on future visual communications.