Real-time 3D interaction for augmented and virtual reality

  • Authors:
  • Simon Prince;Adrian David Check;Farzam Farbiz;Todd Williamson;Nik Johnson;Mark Billinghurst;Hirokazu Kato

  • Affiliations:
  • National University of Singapore;National University of Singapore;National University of Singapore;Zaxel Systems;Zaxel Systems;University of Washington;Hiroshima State University

  • Venue:
  • ACM SIGGRAPH 2002 conference abstracts and applications
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We demonstrate a real-time 3-D augmented reality video-conferencing system. The observer sees the real world from his viewpoint, but modified so that the image of a remote collaborator is rendered into the scene. For each frame, we estimate the transformation between the camera and a fiducial marker using techniques developed in Kato and Billinghurst [1999]. We use a shape-from-silhouette algorithm to generate the appropriate view of the collaborator in real time. This is based on simultaneous measurements from fifteen calibrated cameras that surround the collaborator. The novel view is then superimposed upon the real world image and appropriate directional audio is added. The result gives the strong impression that the virtual collaborator is a real part of the scene.