Depth perceptual region-of-interest based multiview video coding

  • Authors:

  • Yun Zhang;Gangyi Jiang;Mei Yu;You Yang;Zongju Peng;Ken Chen

  • Affiliations:

  • Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China and Institute of Computing Technology, Chinese Academic of Sciences, Beijing 100080, China and Graduate Scho ...;Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China and Institute of Computing Technology, Chinese Academic of Sciences, Beijing 100080, China;Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China;Institute of Computing Technology, Chinese Academic of Sciences, Beijing 100080, China;Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China;Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China

  • Venue:
  • Journal of Visual Communication and Image Representation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

MultiView Video (MVV) has attracted considerable attention recently since it is capable of providing users with three-dimensional perception and interactive functionalities. However, these MVV data require large mount of storage and bandwidth in network transmission. In this paper, we present a novel Depth Perceptual Region-Of-Interest (DP-ROI) based Multiview Video Coding (RMVC) scheme to extensively improve data compression efficiency by exploiting redundancies in depth perception. Firstly, we define DP-ROI according to the three-dimensional depth sensation of human visual system. Then, a framework of RMVC is developed to improve compression efficiency by properly segmenting the MVV into different macroblock wise DP-ROIs and encoding them separately. And then, we propose three fast depth based DP-ROI extraction and tracking algorithms by jointly using motion, texture, depth as well as previous extracted DP-ROIs. Finally, on the basis of the extracted DP-ROI, bit allocation optimization model is proposed to allocate more bits on DP-ROIs for high image quality and fewer bits on background regions for high compression ratio. Experimental results show that the presented RMVC scheme achieves significant coding gains at high rate while comparing with original joint multiview video model. To be specific, up to 14.22-23.32% bit-rate are saved while 0.16-0.68dB coding gains are achieved in DP-ROIs at the cost of the image quality degradation in background.