Non-rigid shape matching using geometry and photometry

  • Authors:
  • Nicolas Thorstensen;Renaud Keriven

  • Affiliations:
  • IMAGINE, Universite Paris-Est, Ecole des Ponts ParisTech;IMAGINE, Universite Paris-Est, Ecole des Ponts ParisTech

  • Venue:
  • ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we tackle the problem of finding correspondences between three-dimensional reconstructions of a deformable surface at different time steps We suppose that (i) the mechanical underlying model imposes time-constant geodesic distances between points on the surface; and that (ii) images of the real surface are available This is for instance the case in spatio-temporal shape from videos (e.g multi-view stereo, visual hulls, etc.) when the surface is supposed approximatively unstretchable These assumptions allow to exploit both geometry and photometry In particular we propose an energy based formulation of the problem, extending the work of Bronstein et al. [1] On the one hand, we show that photometry (i) improves accuracy in case of locally elastic deformations or noisy surfaces and (ii) allows to still find the right solution when [1] fails because of ambiguities (e.g symmetries) On the other hand, using geometry makes it possible to match shapes that have undergone large motion, which is not possible with usual photometric methods Numerical experiments prove the efficiency of our method on synthetic and real data.