Depth estimation by cost volume with spatial-temporal cross-based local multipoint filter using projecting infrared patterns

Authors:
Kensuke Hisatomi;Kensuke Ikeya;Miwa Katayama;Yuichi Iwadate;Kiyoharu Aizawa
Affiliations:
University of Tokyo, Tokyo, Japan;NHK STRL, Tokyo, Japan;NHK STRL, Tokyo, Japan;NHK STRL, Tokyo, Japan;University of Tokyo, Tokyo, Japan
Venue:
Proceedings of the 10th European Conference on Visual Media Production
Year:
2013

Citing 11
Cited 0

A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms

International Journal of Computer Vision
Computing Geodesics and Minimal Surfaces via Graph Cuts

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 3 - Volume 03
Cross-based local stereo matching using orthogonal integral images

IEEE Transactions on Circuits and Systems for Video Technology
Guided image filtering

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Joint Multi-Layer Segmentation and Reconstruction for Free-Viewpoint Video Applications

International Journal of Computer Vision
3D Archive System for Traditional Performing Arts

International Journal of Computer Vision
Depth Estimation from Three Cameras Using Belief Propagation: 3D Modelling of Sumo Wrestling

CVMP '11 Proceedings of the 2011 Conference for Visual Media Production
Shake'n'sense: reducing interference for overlapping structured light depth cameras

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Reducing interference between multiple structured light depth sensors using motion

VR '12 Proceedings of the 2012 IEEE Virtual Reality
Cross-based local multipoint filtering

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a robust depth-estimation method that projects infrared dot-patterns in order to estimate depth maps of a low-texture dynamic scene. Two infrared cameras are utilized to observe the projected infrared patterns, and the depth maps are estimated by stereo matching of the patterns. The stereo matching makes use of a cost volume with a cross-based local multipoint filter (CLMF) which is an edge-preserving smoothing filter using adaptive kernels. The adaptive kernel is a window that is adaptively decided by selecting pixels of similar color. In this paper, CLMF is extended (st-CLMF) beyond the spatial dimension to the temporal dimension. The proposed method is evaluated using scenes including low-texture regions. The experimental results show that st-CMLF can perform accurate depth estimations.