Digilog miniature: real-time, immersive, and interactive AR on miniatures

  • Authors:
  • Kiyoung Kim;Youngmin Park;Woontack Woo

  • Affiliations:
  • GIST U-VR Lab;GIST U-VR Lab;GIST U-VR Lab

  • Venue:
  • Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a framework to realize a real-time, immersive, and interactive Augmented Reality running on a miniature. We achieve these challenging goals by harmonizing unknown tracking data generation, structure-supported marker-less tracking, and user-event handling within VR authoring tool. We cluster unknown 3D keypoints by using selective keyframe-based 3D reconstruction for real-time parallel detection by tracking. Afterwards, we align 3D keypoints and CAD models by using user-assisted iterative fitting method to resolve occlusions and shadows between real and virtual objects. At last, we retrieve active/passive commands by interpreting events from users' speech, ray-pointing interface, and camera distance to interact with the augmented contents. We developed the digilog miniature system to show validity of the proposed framework. According to experimental results, the system worked about 20 frames per second: 7.82 ms for tracking, 38.35 ms for contents rendering. The proposed framework can be applied to storytelling, manufacturing simulation, urban planning and so on.