Towards more engaging telepresence by face tracking

  • Authors:
  • Yuanwei Chua;Keng Peng Tee;Rui Yan;Liyuan Li;Zhiyong Huang

  • Affiliations:
  • A*STAR, Singapore;A*STAR, Singapore;A*STAR, Singapore;A*STAR, Singapore;A*STAR, Singapore

  • Venue:
  • Proceedings of the Workshop at SIGGRAPH Asia
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Video conferencing is widely used with the growing popularity of Internet call systems such as FaceTime, Skype and broad band network. However, people still find it unnatural compared to face-to-face talk. One of the problems is that the display screen and web camera are fixed and do not track a person when he/she moves, resulting in an incomplete view and unnaturalness to the other party. In this paper, we propose a more engaging telepresence solution based on a tablet mounted on a pan-tilt robotic base. During video-conferencing, the human face is tracked by the built-in camera on the tablet. The tracking results will drive the robotic base in real-time such that the display and camera will follow the moving face. In this way, it not only sends the captured face images, but also gives natural feeling of head movement as in a face-to-face conversation. We conducted user studies and the findings showed preference of the proposed system.