Mobile AR using pre-captured omnidirectional images

Authors:
Takayuki Akaguma;Fumio Okura;Tomokazu Sato;Naokazu Yokoya
Affiliations:
Nara Institute of Science and Technology (NAIST);Nara Institute of Science and Technology (NAIST);Nara Institute of Science and Technology (NAIST);Nara Institute of Science and Technology (NAIST)
Venue:
SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications
Year:
2013

Citing 12
Cited 0

Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Photographic tone reproduction for digital images

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Situated Documentaries: Embedding Multimedia Presentations in the Real World

ISWC '99 Proceedings of the 3rd IEEE International Symposium on Wearable Computers
Image Inpainting Considering Brightness Change and Spatial Locality of Textures and Its Evaluation

PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
Parallel Tracking and Mapping on a camera phone

ISMAR '09 Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality
Cultural Heritage Layers: Integrating Historic Media in Augmented Reality

VSMM '09 Proceedings of the 2009 15th International Conference on Virtual Systems and Multimedia
Mobile Augmented Reality: Real-time and accurate extrinsic camera parameter estimation using feature landmark database for augmented reality

Computers and Graphics
Full Spherical High Dynamic Range Imaging from the Sky

ICME '12 Proceedings of the 2012 IEEE International Conference on Multimedia and Expo
Wide-area scene mapping for mobile visual tracking

ISMAR '12 Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
High-quality reflections, refractions, and caustics in Augmented Reality and their contribution to visual coherence

ISMAR '12 Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Instant indirect illumination for dynamic mixed reality scenes

ISMAR '12 Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Real-time photometric registration from arbitrary geometry

ISMAR '12 Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

Quantified Score

Hi-index	0.00

Visualization

Abstract

In the field of augmented reality (AR), geometric and photometric registration is routinely achieved in real time. However, real-time geometric registration often leads to misalignment (e.g., jitter and drift) due to the error from camera pose estimation. Due to limited resources on mobile devices, it is also difficult to implement state-of-the-art techniques for photometric registration on mobile AR systems. In order to solve these problems, we developed a mobile AR system in a significantly different way from conventional systems. In this system, captured omnidirectional images and virtual objects are registered geometrically and photometrically in an offline rendering process. The appropriate part of the prerendered omnidirectional AR image is shown to a user through a mobile device with online registration between the real world and the pre-captured image. In order to investigate the validity of our new framework for mobile AR, we conducted experiments using the prototype system on a real site in Todai-ji Temple, a famous world cultural heritage site in Japan.