Physically-Valid View Synthesis by Image Interplation

  • Authors:
  • Steven Seitz;Charles Dyer

  • Affiliations:
  • -;-

  • Venue:
  • VSR '95 Proceedings of the IEEE Workshop on Representation of Visual Scenes
  • Year:
  • 1995

Quantified Score

Hi-index 0.01

Visualization

Abstract

Image warping is a popular tool for smoothly trans- forming one image to another. "Morphing" techniques based on geometric image interpolation create compelling visual effects, but the validity of such transformations has not been established. In particular, does SD interpolation of two views of the same scene pro-duce a sequence of physically valid in-between views of that scene? In this paper, we describe a simple image rectification procedure which guarantees that interpolation does in fact produce valid views, under generic assumptions about visibility and the projection process. Towards this end, it is first shown that two basis views are sufficient to predict the appearance of the scene within a specific range of new viewpoints. Second, it is demonstrated that interpolation of the rectified basis images produces exactly this range of views. Finally, it is shown that generating this range of views is a the oretically well-posed problem, requiring neither knowledge of camera positions nor 3D scene reconstruction. A scanline algorithm for view interpolation is presented that requires only four user-provided feature correspondences to produce valid orthographic views. The quality of the resulting images is demonstrated with interpolations of real imagery.