Achieving robust alignment for outdoor mixed reality using 3D range data

Authors:
Masaki Inaba;Atsuhiko Banno;Takeshi Oishi;Katsushi Ikeuchi
Affiliations:
The University of Tokyo, Tokyo, Japan;Advanced Industrial Science and Technology, Ibaraki, Japan;The University of Tokyo, Tokyo, Japan;The University of Tokyo, Tokyo, Japan
Venue:
Proceedings of the 18th ACM symposium on Virtual reality software and technology
Year:
2012

Citing 21
Cited 0

Camera Calibration with Distortion Models and Accuracy Evaluation

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Flexible New Technique for Camera Calibration

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Recent Advances in Augmented Reality

IEEE Computer Graphics and Applications
Image-Based Lighting

IEEE Computer Graphics and Applications
Archeoguide: An Augmented Reality Guide for Archaeological Sites

IEEE Computer Graphics and Applications
Archeoguide: An Augmented Reality Guide for Archaeological Sites

IEEE Computer Graphics and Applications
Fully Automated and Stable Registration for Augmented Reality Applications

ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
The Great Buddha Project: Modeling Cultural Heritage for VR Systems through Observation

ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Mixing virtual and real scenes in the site of ancient Pompeii: Research Articles

Computer Animation and Virtual Worlds
CSIFT: A SIFT Descriptor with Color Invariant Characteristics

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Going out: robust model-based tracking for outdoor augmented reality

ISMAR '06 Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality
Parallel Tracking and Mapping for Small AR Workspaces

ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
Global pose estimation using multi-sensor fusion for outdoor Augmented Reality

ISMAR '09 Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality
Adaptable model-based tracking using analysis-by-synthesis techniques

CAIP'07 Proceedings of the 12th international conference on Computer analysis of images and patterns
SURF: speeded up robust features

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Machine learning for high-speed corner detection

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Tracking-by-synthesis using point features and pyramidal blurring

ISMAR '11 Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality
Real-time panoramic mapping and tracking on mobile phones

VR '10 Proceedings of the 2010 IEEE Virtual Reality Conference
DTAM: Dense tracking and mapping in real-time

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

Mixed reality (MR) technology can be applied to various applications such as architecture, advertising, and navigation systems, so the desire to utilize MR in outdoor environments has been increasing. In order to utilize MR, it is necessary to achieve alignment super imposing virtual contents in the desired position. However, because light changes continually in outdoor environments, and the appearance of real objects changes also, in some cases the previous image-based alignment methods do not work well. In this paper, a robust image-based alignment method to be used in outdoor environments is proposed. In the proposed method, the albedo of real objects is estimated using 3D shapes of these objects in advance, and the appearance is reproduced from the albedo and current light environment. The appearance of real objects and reproduced image becomes close, so a robust image-based alignment is achieved.