Virtual viewpoint disparity estimation and convergence check for real-time view synthesis

Authors:
In-Yong Shin;Yo-Sung Ho
Affiliations:
Gwangju Institute of Science and Technology (GIST), Gwangju, Korea;Gwangju Institute of Science and Technology (GIST), Gwangju, Korea
Venue:
PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part I
Year:
2011

Citing 6
Cited 0

Fast Approximate Energy Minimization via Graph Cuts

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multi-camera Scene Reconstruction via Graph Cuts

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Stereo Matching Using Belief Propagation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Comparison of Graph Cuts with Belief Propagation for Stereo, using Identical MRF Parameters

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling

IEEE Transactions on Pattern Analysis and Machine Intelligence
Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video

PCS'09 Proceedings of the 27th conference on Picture Coding Symposium

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a new method for real-time disparity estimation and intermediate view synthesis from stereoscopic images. Some 3D video systems employ both the left and right depth images for virtual view synthesis; however, we estimate only one disparity map at a virtual viewpoint. In addition, we utilize hierarchical belief propagation and convergence check methods to find the global solution rapidly. In order to use the virtual viewpoint disparity map for intermediate view synthesis, we build an occlusion map that describes the occlusion information in the virtual viewpoint region of the reference image. We have also implemented the total system using GPU programming to synthesize virtual viewpoint images in real time.