Real-time spatial and depth upsampling for range data

Authors:
Xueqin Xiang;Guangxia Li;Jing Tong;Mingmin Zhang;Zhigeng Pan
Affiliations:
State key Lab of Computer Aided Design and Computer Graphics, Zhejiang University, Hangzhou, Zhejiang Province, China;State key Lab of Computer Aided Design and Computer Graphics, Zhejiang University, Hangzhou, Zhejiang Province, China;State key Lab of Computer Aided Design and Computer Graphics, Zhejiang University, Hangzhou, Zhejiang Province, China;State key Lab of Computer Aided Design and Computer Graphics, Zhejiang University, Hangzhou, Zhejiang Province, China;State key Lab of Computer Aided Design and Computer Graphics, Zhejiang University, Hangzhou, Zhejiang Province, China
Venue:
Transactions on computational science XII
Year:
2011

Citing 13
Cited 0

A limited memory algorithm for bound constrained optimization

SIAM Journal on Scientific Computing
Learning Low-Level Vision

International Journal of Computer Vision - Special issue on statistical and computational theories of vision: modeling, learning, sampling and computing, Part I
Fast bilateral filtering for the display of high-dynamic-range images

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Bilateral Filtering for Gray and Color Images

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Comparison of Graph Cuts with Belief Propagation for Stereo, using Identical MRF Parameters

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Sampling the Disparity Space Image

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Fast median and bilateral filtering

ACM SIGGRAPH 2006 Papers
Joint bilateral upsampling

ACM SIGGRAPH 2007 papers
Real-time edge-aware image processing with the bilateral grid

ACM SIGGRAPH 2007 papers
Sub-pixel data fusion and edge-enhanced distance refinement for 2D/3D images

International Journal of Intelligent Systems Technologies and Applications
Sub-pixel data fusion and edge-enhanced distance refinement for 2D/3D images

International Journal of Intelligent Systems Technologies and Applications
Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling

IEEE Transactions on Pattern Analysis and Machine Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

Current active 3D range sensors, such as time-of-flight cameras, enable acquiring of range maps at video frame rate. Unfortunately, the resolution of the range maps is quite limited and the captured data are typically contaminated by noise. We therefore present a simple pipeline to enhance the quality as well as improve the spatial and depth resolution of range data in real time. To improve the spatial resolution of range data, we first upsample the depth information with the data from high resolution video camera. And then, a new strategy is utilized to increase the sub-pixel accuracy. We show that these techniques can greatly improve the reconstruction quality, boost the resolution of the range data to that of video sensor while achieving high computational efficiency for a real-time application.