DOVE: drawing over video environment

  • Authors:
  • Jiazhi Ou;Xilin Chen;Susan R. Fussell;Jie Yang

  • Affiliations:
  • Carnegie Mellon University, Pitsburgh, PA;Carnegie Mellon University, Pitsburgh, PA;Carnegie Mellon University, Pitsburgh, PA;Carnegie Mellon University, Pitsburgh, PA

  • Venue:
  • MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

We demonstrate a multimedia system that integrates pen-based gesture and live video to support collaboration on physical tasks. The system combines network IP cameras, desktop PCs, and tablet PCs (or PDAs) to allow a remote helper to draw on a video feed of a workspace as he/she provides task instructions. A gesture recognition component enables the system both to normalize freehand drawings to facilitate communication with remote partners and to use pen-based input as a camera control device. The system also embeds some tools, such as controlled video delay, gesture delay, and remote camera pan-tilt-zoom control. The system provides a software environment for studying multimodal/multimedia communication for remote collaborative physical tasks.