Object recognition and localization while tracking and mapping

  • Authors:
  • Robert O. Castle;David W. Murray

  • Affiliations:
  • Active Vision Laboratory, Department of Engineering Science, University of Oxford, UK;Active Vision Laboratory, Department of Engineering Science, University of Oxford, UK

  • Venue:
  • ISMAR '09 Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper demonstrates how objects can be recognized, reconstructed, and localized within a 3D map, using observations and matching of SIFT features in keyframes. The keyframes arise as part of a frame-rate process of parallel camera tracking and mapping, in which the keyframe camera poses and 3D map points are refined using bundle adjustment. The object reconstruction process runs independently, and in parallel to, the tracking and mapping processes. Detected objects are automatically labelled on the user's display using predefined annotations. The annotations are also used to highlight areas of interest upon the objects to the user.