Outdoor gallery and its photometric issues

Authors:
Katsushi Ikeuchi;Takeshi Oishi;Masataka Kagesawa;Atsuhiko Banno;Rei Kawakami;Tetsuya Kakuta;Yasuhide Okamoto;Boun Vinh Lu
Affiliations:
The University of Tokyo;The University of Tokyo;The University of Tokyo;The University of Tokyo;The University of Tokyo;AsukaLab Inc.;AsukaLab Inc.;The University of Tokyo
Venue:
Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry
Year:
2010

Citing 4
Cited 0

Shading and Shadowing of Architecture in Mixed Reality

ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
Bilayer Segmentation of Live Video

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Detection of moving objects and cast shadows using a spherical vision camera for outdoor mixed reality

Proceedings of the 2008 ACM symposium on Virtual reality software and technology
Background cut

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have been developing an outdoor gallery system in Asukakyo. Asukakyo is one of the ancient capitals, which is well-known to has lots of temples, palaces and buildings. Nevertheless, most of the assets have been deteriorated after more than fourteen centuries. The outdoor gallery system introduces the virtual appearance of ancient Asukakyo to visitors at the original site with the help of Mixed Reality (MR). To reconstruct the virtual Asukakyo in the outdoor gallery system, it is necessary to handle occlusion problem in synthesizing virtual objects correctly into the real scene with respect to existing foregrounds and shadows. Furthermore, outdoor environment makes the task more difficult due to the unpredictable illumination changes. This paper proposes novel outdoor illumination constraints for resolving the foreground occlusion problem in outdoor environment for the outdoor gallery system. The constraints can be also integrated into a probabilistic model of multiple cues for a better segmentation of the foreground. In addition, we introduce an effective method to resolve the shadow occlusion problem by using shadow detection and recasting with a spherical vision camera. We have applied the method in our outdoor gallery system in Asukakyo and verified the effectiveness of the method.