Novel-View Synthesis of Outdoor Sport Events Using an Adaptive View-Dependent Geometry

  • Authors:
  • Marcel Germann;Tiberiu Popa;Richard Keiser;Remo Ziegler;Markus Gross

  • Affiliations:
  • ETH Zurich, Switzerland.;ETH Zurich, Switzerland.;Libero Vision AG, Switzerland;Libero Vision AG, Switzerland;ETH Zurich, Switzerland.

  • Venue:
  • Computer Graphics Forum
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a novel fully automatic method for novel-viewpoint synthesis. Our method robustly handles multi-camera setups featuring wide-baselines in an uncontrolled environment. In a first step, robust and sparse point correspondences are found based on an extension of the Daisy features [TLF10]. These correspondences together with back-projection errors are used to drive a novel adaptive coarse to fine reconstruction method, allowing to approximate detailed geometry while avoiding an extreme triangle count. To render the scene from arbitrary viewpoints we use a view-dependent blending of color information in combination with a view-dependent geometry morph. The view-dependent geometry compensates for misalignments caused by calibration errors. We demonstrate that our method works well under arbitrary lighting conditions with as little as two cameras featuring wide-baselines. The footage taken from real sports broadcast events contains fine geometric structures, which result in nice novel-viewpoint renderings despite of the low resolution in the images. © 2012 Wiley Periodicals, Inc.