3D Live: Real Time Captured Content for Mixed Reality

  • Authors:
  • Simon Prince;Adrian David Cheok;Farzam Farbiz;Todd Williamson;Nik Johnson;Mark Billinghurst;Hirokazu Kato

  • Affiliations:
  • -;-;-;-;-;-;-

  • Venue:
  • ISMAR '02 Proceedings of the 1st International Symposium on Mixed and Augmented Reality
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a complete system for live capture of 3-D content and simultaneous presentation in augmented reality. The user sees the real world from his viewpoint, but modified so that the image of a remote collaborator is rendered into the scene. Fifteen cameras surround the collaborator, and the resulting video streams are used to construct a three-dimensional model of the subject using a shape-from-silhouette algorithm. Users view a two-dimensional fiducial marker using a video-see-through augmented reality interface. The geometric relationship between the marker and head-mounted camera is calculated, and the equivalent view of the subject is computed and drawn into the scene. Our system can generate 384 脳 288 pixel images of the models at 25 fps, with a latency of