3-D live: real time interaction for mixed reality

  • Authors:
  • Simon Prince;Adrian David Cheok;Farzam Farbiz;Todd Williamson;Nik Johnson;Mark Billinghurst;Hirokazu Kato

  • Affiliations:
  • National University of Singapore;National University of Singapore;National University of Singapore;Zaxel Systems;Zaxel Systems;University of Washington;Hiroshima State University

  • Venue:
  • CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe a real-time 3-D augmented reality video- conferencing system. With this technology, an observer sees the real world from his viewpoint, but modified so that the image of a remote collaborator is rendered into the scene. We register the image of the collaborator with the world by estimating the 3-D transformation between the camera and a fiducial marker. We describe a novel shape- from-silhouette algorithm, which generates the appropriate view of the collaborator and the associated depth map at 30 fps. When this view is superimposed upon the real world, it gives the strong impression that the collaborator is a real part of the scene. We also demonstrate interaction in virtual environments with a "live" fully 3-D collaborator. Finally, we consider interaction between users in the real world and collaborators in a virtual space, using a "tangible" AR interface.