A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
International Journal of Computer Vision
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
Computer
IEEE Transactions on Circuits and Systems for Video Technology
An Epipolar Geometry-Based Fast Disparity Estimation Algorithm for Multiview Image and Video Coding
IEEE Transactions on Circuits and Systems for Video Technology
View Scalable Multiview Video Coding Using 3-D Warping With Depth Map
IEEE Transactions on Circuits and Systems for Video Technology
Depth perceptual region-of-interest based multiview video coding
Journal of Visual Communication and Image Representation
Stereoscopic visual attention-based regional bit allocation optimization for multiview video coding
EURASIP Journal on Advances in Signal Processing
Least square based view synthesis prediction for multi-view video coding
PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
View-spatial-temporal post-refinement for view synthesis in 3D video systems
Image Communication
Stereo/multiview picture quality: Overview and recent advances
Image Communication
Adaptive Learning Based View Synthesis Prediction for Multi-View Video Coding
Journal of Signal Processing Systems
Hi-index | 0.00 |
We propose a rate-distortion-optimized framework that incorporates view synthesis for improved prediction in multiview video coding. In the proposed scheme, auxiliary information, including depth data, is encoded and used at the decoder to generate the view synthesis prediction data. The proposed method employs optimal mode decision including view synthesis prediction, and sub-pixel reference matching to improve prediction accuracy of the view synthesis prediction. Novel variants of the skip and direct modes are also presented, which infer the depth and correction vector information from neighboring blocks in a synthesized reference picture to reduce the bits needed for the view synthesis prediction mode. We demonstrate two multiview video coding scenarios in which view synthesis prediction is employed. In the first scenario, the goal is to improve the coding efficiency of multiview video where block-based depths and correction vectors are encoded by CABAC in a lossless manner on a macroblock basis. A variable block-size depth/motion search algorithm is described. Experimental results demonstrate that view synthesis prediction does provide some coding gains when combined with disparity-compensated prediction. In the second scenario, the goal is to use view synthesis prediction for reducing rate overhead incurred by transmitting depth maps for improved support of 3DTV and free-viewpoint video applications. It is assumed that the complete depth map for each view is encoded separately from the multiview video and used at the receiver to generate intermediate views. We utilize this information for view synthesis prediction to improve overall coding efficiency. Experimental results show that the rate overhead incurred by coding depth maps of varying quality could be offset by utilizing the proposed view synthesis prediction techniques to reduce the bitrate required for coding multiview video.