A Stereoscopic Video See-Through Augmented Reality System Based on Real-Time Vision-Based Registration

  • Authors:
  • Masayuki Kanbara;Haruo Takemura;Naokazu Yokoya;Takashi Okuma

  • Affiliations:
  • -;-;-;-

  • Venue:
  • VR '00 Proceedings of the IEEE Virtual Reality 2000 Conference
  • Year:
  • 2000

Quantified Score

Hi-index 0.01

Visualization

Abstract

In an augmented reality system, it is required to obtain the position and orientation of the user's viewpoint to display the composed image maintaining correct registration of real and virtual worlds. All the procedures must be done in real-time.This paper proposes a method for augmented reality with a stereovision sensor and video see-through head mounted display. It can synchronize the display timing between the virtual and real worlds, so that an alignment error is reduced. The method calculates camera parameters from three markers in image sequences captured by a pair of stereo cameras mounted on a HMD. In addition, it estimates depth of real world from a pair of stereo images to generate a composed image maintaining consistent occlusions between real and virtual objects. A region of depth estimation is efficiently limited by calculating a position of virtual object using camera parameters. Finally, we have developed a video see-through augmented reality system, which mainly consists of a pair of stereo cameras mounted on the HMD and a standard graphics workstation. The feasibility of the system has been successfully demonstrated with experiments.