Ninja on a Plane: Automatic Discovery of Physical Planes for Augmented Reality Using Visual SLAM

  • Authors:
  • Denis Chekhlov;Andrew P. Gee;Andrew Calway;Walterio Mayol-Cuevas

  • Affiliations:
  • Department of Computer Science, University of Bristol, Woodland Road BS8 1UB, UK. e-mail: chekhlov@cs.bris.ac.uk;Department of Computer Science, University of Bristol, Woodland Road BS8 1UB, UK. e-mail: gee@cs.bris.ac.uk;Department of Computer Science, University of Bristol, Woodland Road BS8 1UB, UK. e-mail: andrew@cs.bris.ac.uk;Department of Computer Science, University of Bristol, Woodland Road BS8 1UB, UK. e-mail: wmayol@cs.bris.ac.uk

  • Venue:
  • ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
  • Year:
  • 2007

Quantified Score

Hi-index 0.01

Visualization

Abstract

Most work in visual augmented reality (AR) employs predefined markers or models that simplify the algorithms needed for sensor positioning and augmentation but at the cost of imposing restrictions on the areas of operation and on interactivity. This paper presents a simple game in which an AR agent has to navigate using real planar surfaces on objects that are dynamically added to an unprepared environment. An extended Kalman filter (EKF) simultaneous localisation and mapping (SLAM) framework with automatic plane discovery is used to enable the player to interactively build a structured map of the game environment using a single, agile camera. By using SLAM, we are able to achieve real-time interactivity and maintain rigorous estimates of the system's uncertainty, which enables the effects of high quality estimates to be propagated to other features (points and planes) even if they are outside the camera's current field of view.