Vision: mapping the world in 3d through first-person vision devices with mercator

  • Authors:
  • Pieter Simoens;Tim Verbelen;Bart Dhoedt

  • Affiliations:
  • Ghent University College - iMinds, Gent, Belgium;Ghent University, Gent, Belgium;Ghent University, Gent, Belgium

  • Venue:
  • Proceeding of the fourth ACM workshop on Mobile cloud computing and services
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Many vision-based applications, especially in the domain of augmented reality, must align the camera position in the observed scene. However, traditional cameras only register textures of the observed scene. The reconstruction of depth information from 2D images is compute intensive and inevitably results in loss of accuracy. In this article, we present Mercator, a cloudlet-based system to build a 3D model of the world on which other applications can be built. The model is continuously updated, refined and expanded by crowd-sourcing depth data from 3D cameras on head-mounted devices such as Google Glass. Mercator scales up to a worldwide system by distributing the model over the network edge in geographically close cloudlets. We present the software building blocks of the system, and discuss challenges related to data management, privacy and programming model.