Joint estimation of motion, structure and geometry from stereo sequences

  • Authors:

  • Levi Valgaerts;Andrés Bruhn;Henning Zimmer;Joachim Weickert;Carsten Stoll;Christian Theobalt

  • Affiliations:

  • Mathematical Image Analysis Group, Saarland University, Saarbrücken, Germany;Mathematical Image Analysis Group, Saarland University, Saarbrücken, Germany;Mathematical Image Analysis Group, Saarland University, Saarbrücken, Germany;Mathematical Image Analysis Group, Saarland University, Saarbrücken, Germany;Max-Planck Institute for Informatics, Saarbrücken, Germany;Max-Planck Institute for Informatics, Saarbrücken, Germany

  • Venue:
  • ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel variational method for the simultaneous estimation of dense scene flow and structure from stereo sequences. In contrast to existing approaches that rely on a fully calibrated camera setup, we assume that only the intrinsic camera parameters are known. To couple the estimation of motion, structure and geometry, we propose a joint energy functional that integrates spatial and temporal information from two subsequent image pairs subject to an unknown stereo setup. We further introduce a normalisation of image and stereo constraints such that deviations from model assumptions can be interpreted in a geometrical way. Finally, we suggest a separate discontinuity-preserving regularisation to improve the accuracy. Experiments on calibrated and uncalibrated data demonstrate the excellent performance of our approach. We even outperform recent techniques for the rectified case that make explicit use of the simplified geometry.