Projective rectification-based view interpolation for multiview video coding and free viewpoint generation

  • Authors:
  • Xiaoyu Xiu;Jie Liang

  • Affiliations:
  • School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada;School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada

  • Venue:
  • PCS'09 Proceedings of the 27th conference on Picture Coding Symposium
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

A projective rectification-based view interpolation algorithm is developed for multiview video coding and free viewpoint video. It first calculates the fundamental matrix between two views without using any camera parameter. The two views are then resampled to have horizontal and matched epipolar lines. One-dimensional disparity is estimated next, which is used to interpolate the image for an intermediate viewpoint. After unrectification, the interpolated view can be displayed directly for free viewpoint video purpose. It can also be used as a reference to encode data of an intermediate camera. Experimental results show that the interpolated views can be 3 dB better than existing method. Video coding results illustrate that the method can provide up to 1.3 dB improvement over JMVC.