New color correction method of multi-view images for view rendering in free-viewpoint television
WSEAS Transactions on Computers
Rendering-oriented decoding for a distributed multiview coding system using a coset code
Journal on Image and Video Processing - Special issue on distributed video coding
Fine-granular motion matching for inter-view motion skip mode in multiview video coding
IEEE Transactions on Circuits and Systems for Video Technology
Coding techniques in multiview video coding and joint multiview video model
PCS'09 Proceedings of the 27th conference on Picture Coding Symposium
Adaptive appearance compensated view synthesis prediction for multiview video coding
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Stereo/multiview picture quality: Overview and recent advances
Image Communication
| Hi-index | 0.00 |
We propose new tools for multiview video coding (MVC) that aim to compensate for mismatches between video frames corresponding to different views. Such mismatches could be caused by different shooting positions of the cameras and/or heterogeneous camera settings. In particular, we consider illumination and focus mismatches across views, i.e., such that different portions of a video frame can undergo different illumination and blurriness/sharpness changes with respect to the corresponding areas in frames from the other views. Models for illumination and focus mismatches are proposed and new coding tools are developed from the models. We propose a block-based illumination compensation (IC) technique and a depth-dependent adaptive reference filtering (ARF) approach for cross-view prediction in multiview video coding. In IC, disparity field and illumination changes are jointly computed as part of the disparity estimation search. IC can be adaptively applied by taking into account the rate-distortion characteristics of each block. For ARF, the disparity fields are used to estimate scene depth, such that video frames are first divided into regions with different scene-depth levels. A 2-D filter is then selected for each scene-depth level. These filters are chosen to minimize residual energy, with the goal of compensating for focus mismatches. The resulting filters are applied to the reference frames to generate better matches for cross-view prediction. Furthermore, we propose a coding system that combines IC and ARF. Adjustments are made so as to maximize the gains achieved by using both coding tools, while reducing the complexity of the final integrated system. We analyze the complexity of all proposed methods and present simulation results of IC, ARF and combined system for different multiview sequences based on the H.264/AVC reference codec. When applying the proposed tool to cross-view coding we observe gains of up 1.3 dB as compared to directly using an H.264/AVC cod- ec to perform predictive coding across views.