The effects of multiview depth video compression on multiview rendering

  • Authors:

  • P. Merkle;Y. Morvan;A. Smolic;D. Farin;K. Müller;P. H. N. de With;T. Wiegand

  • Affiliations:

  • Fraunhofer Institute for Telecommunications Heinrich-Hertz-Institut, Image Processing Department, Einsteinufer 37, 10587 Berlin, Germany;Eindhoven University of Technology, Signal Processing Systems, PO Box 513, 5600 MB Eindhoven, The Netherlands;Fraunhofer Institute for Telecommunications Heinrich-Hertz-Institut, Image Processing Department, Einsteinufer 37, 10587 Berlin, Germany;Eindhoven University of Technology, Signal Processing Systems, PO Box 513, 5600 MB Eindhoven, The Netherlands;Fraunhofer Institute for Telecommunications Heinrich-Hertz-Institut, Image Processing Department, Einsteinufer 37, 10587 Berlin, Germany;Eindhoven University of Technology, Signal Processing Systems, PO Box 513, 5600 MB Eindhoven, The Netherlands;Fraunhofer Institute for Telecommunications Heinrich-Hertz-Institut, Image Processing Department, Einsteinufer 37, 10587 Berlin, Germany and Image Communication Chair, Technical University of Berl ...

  • Venue:
  • Image Communication
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article investigates the interaction between different techniques for depth compression and view synthesis rendering with multiview video plus scene depth data. Two different approaches for depth coding are compared, namely H.264/MVC, using temporal and inter-view reference images for efficient prediction, and the novel platelet-based coding algorithm, characterized by being adapted to the special characteristics of depth-images. Since depth-images are a 2D representation of the 3D scene geometry, depth-image errors lead to geometry distortions. Therefore, the influence of geometry distortions resulting from coding artifacts is evaluated for both coding approaches in two different ways. First, the variation of 3D surface meshes is analyzed using the Hausdorff distance and second, the distortion is evaluated for 2D view synthesis rendering, where color and depth information are used together to render virtual intermediate camera views of the scene. The results show that-although its rate-distortion (R-D) performance is worse-platelet-based depth coding outperforms H.264, due to improved sharp edge preservation. Therefore, depth coding needs to be evaluated with respect to geometry distortions.