Detection of moving objects and cast shadows using a spherical vision camera for outdoor mixed reality

Authors:
Tetsuya Kakuta;Lu Boun Vinh;Rei Kawakami;Takeshi Oishi;Katsushi Ikeuchi
Affiliations:
The University of Tokyo;The University of Tokyo;The University of Tokyo;The University of Tokyo;The University of Tokyo
Venue:
Proceedings of the 2008 ACM symposium on Virtual reality software and technology
Year:
2008

Citing 11
Cited 2

Fast Approximate Energy Minimization via Graph Cuts

IEEE Transactions on Pattern Analysis and Machine Intelligence
Solving for Colour Constancy using a Constrained Dichromatic Reflection Model

International Journal of Computer Vision
Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene

IEEE Transactions on Visualization and Computer Graphics
The Use of Dense Stereo Range Data in Augmented Reality

ISMAR '02 Proceedings of the 1st International Symposium on Mixed and Augmented Reality
3D Reconstruction of Stereo Images for Interaction between Real and Virtual Worlds

ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
Bi-Layer Segmentation of Binocular Stereo Video

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Moving Cast Shadow Detection from a Gaussian Mixture Shadow Model

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Occlusion handling for medical augmented reality using a volumetric phantom model

Proceedings of the ACM symposium on Virtual reality software and technology
Consistent Surface Color for Texturing Large Objects in Outdoor Scenes

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Bilayer Segmentation of Live Video

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Background cut

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II

Outdoor gallery and its photometric issues

Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry
Foreground and shadow segmentation based on a homography-correspondence pair

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a method to detect moving objects and remove their shadows for superimposing them on Mixed Reality (MR) systems. We cut out the foreground from a real image using a probability-based segmentation method. Using color, spatial, and temporal priors, we can improve the accuracy of the segmentation. Energy minimization is executed by graph cuts. Then we remove the shadow region from the foreground with F-value calculated from the pixel value and the spectral sensitivity characteristic of the camera. Finally we superimpose virtual objects using the stencil buffer, which is used to limit the area of rendering for each pixel. Synthesized images of an outdoor scene show the efficiency of the proposed method.