Registration of an Uncalibrated Image Pair to a 3D Surface Model

  • Authors:
  • Zsolt Janko;Dmitry Chetverikov

  • Affiliations:
  • Computer and Automation Research Institute and Eötvös Loránd University, Budapest, Hungary;Computer and Automation Research Institute and Eötvös Loránd University, Budapest, Hungary

  • Venue:
  • ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 2 - Volume 02
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

The following data fusion problem is considered: Given a 3D geometric model of an object and two uncalibrated images of the same object, and assuming that the object surface is textured and Lambertian, precisely register the images to the model. Solving this problem is necessary for building a geometrically accurate, photorealistic model from laser-scanned 3D data and high quality images. We generalise the photo-consistency approach by Clarkson et al. [Using photo-consistency to register 2D optical images of the human face to a 3D surface model] to the case of uncalibrated cameras, when both intrinsic and extrinsic parameters are unknown. This gives a user the freedom of taking the pictures by a conventional digital camera, from arbitrary positions and with varying zoom. We discuss a number of possible approaches to the problem and propose a method based on manual pre-registration followed by a genetic optimisation algorithm. The issues of speed and robustness are addressed. Results for real data are shown.