3D Wikipedia: using online text to automatically label and navigate reconstructed geometry

  • Authors:
  • Bryan C. Russell;Ricardo Martin-Brualla;Daniel J. Butler;Steven M. Seitz;Luke Zettlemoyer

  • Affiliations:
  • Intel Labs;University of Washington;University of Washington;University of Washington;University of Washington

  • Venue:
  • ACM Transactions on Graphics (TOG)
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce an approach for analyzing Wikipedia and other text, together with online photos, to produce annotated 3D models of famous tourist sites. The approach is completely automated, and leverages online text and photo co-occurrences via Google Image Search. It enables a number of new interactions, which we demonstrate in a new 3D visualization tool. Text can be selected to move the camera to the corresponding objects, 3D bounding boxes provide anchors back to the text describing them, and the overall narrative of the text provides a temporal guide for automatically flying through the scene to visualize the world as you read about it. We show compelling results on several major tourist sites.