Free-viewpoint depth image based rendering

  • Authors:

  • S. Zinger;L. Do;P. H. N. de With

  • Affiliations:

  • Eindhoven University of Technology, P.O. Box 513, 5600 MB Eindhoven, The Netherlands;Eindhoven University of Technology, P.O. Box 513, 5600 MB Eindhoven, The Netherlands;Eindhoven University of Technology, P.O. Box 513, 5600 MB Eindhoven, The Netherlands and Cyclomedia Technology B.V., P.O. Box 68, 4180 BB Waardenburg, The Netherlands

  • Venue:
  • Journal of Visual Communication and Image Representation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In 3D TV research, one approach is to employ multiple cameras for creating a 3D multi-view signal with the aim to make interactive free-viewpoint selection possible in 3D TV media. This paper explores a new rendering algorithm that enables to compute a free-viewpoint between two reference views from existing cameras. A unique property is that we perform forward warping for both texture and depth simultaneously. Advantages of our rendering are manyfold. First, resampling artifacts are filled in by inverse warping. Second, disocclusions are processed while omitting warping of edges at high discontinuities. Third, our disocclusion inpainting approach explicitly uses depth information. We obtain an average PSNR gain of 3dB and 4.5dB for the 'Breakdancers' and 'Ballet' sequences, respectively, compared recently published results. Moreover, experiments are performed using compressed video from surrounding cameras. The overall system quality is dominated by rendering quality and not by coding.