Monocular template-based reconstruction of smooth and inextensible surfaces

  • Authors:
  • Florent Brunet;Richard Hartley;Adrien Bartoli;Nassir Navab;Remy Malgouyres

  • Affiliations:
  • ISIT, Université d'Auvergne, Clermont-Ferrand, France and CAMPAR, Technische Universtät München, Germany;Research School of Information Sciences, ANU, NICTA, Australia;ISIT, Université d'Auvergne, Clermont-Ferrand, France;CAMPAR, Technische Universtät München, Germany;LIMOS, UMR, Clermont-Ferrand, France

  • Venue:
  • ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present different approaches to reconstructing an inextensible surface from point correspondences between an input image and a template image representing a flat reference shape from a frontoparallel point of view. We first propose a 'point-wise' method, i.e. a method that only retrieves the 3D positions of the point correspondences. This method is formulated as a second-order cone program and it handles inaccuracies in the point measurements. It relies on the fact that the Euclidean distance between two 3D points must be shorter than their geodesic distance (which can easily be computed from the template image). We then present an approach that reconstructs a smooth 3D surface based on Free-Form Deformations. The surface is represented as a smooth map from the template image space to the 3D space. Our idea is to say that the 2D-3D map must be everywhere a local isometry. This induces conditions on the Jacobian matrix of the map which are included in a least-squares minimization problem.