Initial pose estimation for 3D model tracking using learned objective functions

  • Authors:
  • Matthias Wimmer;Bernd Radig

  • Affiliations:
  • Faculty of Science and Engineering, Waseda University, Tokyo, Japan;Institut für Informatik, Technische Universität München, Germany

  • Venue:
  • ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Tracking 3D models in image sequences essentially requires determining their initial position and orientation. Our previous work [14] identifies the objective function as a crucial component for fitting 2D models to images. We state preferable properties of these functions and we propose to learn such a function from annotated example images. This paper extends this approach by making it appropriate to also fit 3D models to images. The correctly fitted model represents the initial pose for model tracking. However, this extension induces nontrivial challenges such as out-of-plane rotations and self occlusion, which cause large variation to the model's surface visible in the image. We solve this issue by connecting the input features of the objective function directly to the model. Furthermore, sequentially executing objective functions specifically learned for different displacements from the correct positions yields highly accurate objective values.