AR cultural heritage reconstruction based on feature landmark database constructed by using omnidirectional range sensor

Authors:
Takafumi Taketomi;Tomokazu Sato;Naokazu Yokoya
Affiliations:
Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma, Nara, Japan;Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma, Nara, Japan;Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma, Nara, Japan
Venue:
ACCV'10 Proceedings of the 2010 international conference on Computer vision - Volume part II
Year:
2010

Citing 5
Cited 0

Computer Vision: Three-Dimensional Data from Images

Computer Vision: Three-Dimensional Data from Images
Fully Automated and Stable Registration for Augmented Reality Applications

ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
Combining Edge and Texture Information for Real-Time Accurate 3D Camera Tracking

ISMAR '04 Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality
Estimating the Location of a Camera with Respect to a 3D Model

3DIM '07 Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling
Parallel Tracking and Mapping for Small AR Workspaces

ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes an application of augmented reality (AR) techniques to virtual cultural heritage reconstruction on the real sites of defunct constructs. To realize AR-based cultural heritage reconstruction, extrinsic camera parameter estimation is required for geometric registration of real and virtual worlds. To estimate extrinsic camera parameters, we use a pre-constructed feature landmark database of the target environment. Conventionally, a feature landmark database has been constructed in a large-scale environment using a structure -from-motion technique for omnidirectional image sequences. However, the accuracy of estimated camera parameters is insufficient for specific applications like AR-based cultural heritage reconstruction, which needs to overlay CG objects at the position close to the user's viewpoint. This is due to the difficulty in compensation of the appearance change of close landmarks only from the sparse 3-D information obtained by structure-from-motion. In this paper, visual patterns of landmarks are compensated for by considering local shapes obtained by omnidirectional range finder to find corresponding landmarks existing close to the user. By using these landmarks with local shapes, accurate geometric registration is achieved for AR sightseeing in historic sites.