Standalone edge-based markerless tracking of fully 3-dimensional objects for handheld augmented reality

  • Authors:
  • João P. Lima;Veronica Teichrieb;Judith Kelner;Robert W. Lindeman

  • Affiliations:
  • Informatics Center - Federal University of Pernambuco, Brazil;Informatics Center - Federal University of Pernambuco, Brazil;Informatics Center - Federal University of Pernambuco, Brazil;Worcester Polytechnic Institute

  • Venue:
  • Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a markerless tracking technique targeted to the Windows Mobile Pocket PC platform. The primary aim of this work is to allow the development of standalone augmented reality applications for handheld devices based on natural feature tracking of fully 3-Dimensional objects. In order to achieve this goal, a model-based tracking approach that relies on edge information was adopted. Since it does not require high processing power, it is suitable for constrained devices such as handhelds. The OpenGL ES graphics library was used to detect the visible edges in a given frame, taking advantage of graphics hardware acceleration when available. In addition, a subset of two computer vision libraries was ported to the Pocket PC platform in order to provide some required algorithms to the markerless mobile solution. They were also adapted to use fixed-point math, with the purpose of improving the overall performance of the routines. The port of these libraries opens up the possibility of having other computer-vision tasks being executed on mobile platforms. An augmented reality application was created using the implemented technique and evaluations were done regarding tracking performance, accuracy and robustness. In most of the tests, the frame rates obtained are suitable for handheld augmented reality and a reasonable estimation of the object pose was provided.