Video-Based In Situ Tagging on Mobile Phones

  • Authors:
  • Wonwoo Lee;Youngmin Park;Vincent Lepetit;Woontack Woo

  • Affiliations:
  • Department of Information and Communications, Gwnagju Institute of Science and Technology, Gwangju, Korea;Department of Information and Communications, Gwnagju Institute of Science and Technology, Gwangju, Korea;Computer Vision Laboratory, École Polytechnique Fédérale de Lausanne (Swiss Federal Institute of Technology), Lausanne, Switzerland;Department of Information and Communications, Gwnagju Institute of Science and Technology, Gwangju, Korea

  • Venue:
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a novel way to augment a real-world scene with minimal user intervention on a mobile phone; the user only has to point the phone camera to the desired location of the augmentation. Our method is valid for horizontal or vertical surfaces only, but this is not a restriction in practice in manmade environments, and it avoids going through any reconstruction of the 3-D scene, which is still a delicate process on a resource-limited system like a mobile phone. Our approach is inspired by recent work on perspective patch recognition, but we adapt it for better performances on mobile phones. We reduce user interaction with real scenes by exploiting the phone accelerometers to relax the need for fronto-parallel views. As a result, we can learn a planar target in situ from arbitrary viewpoints and augment it with virtual objects in real-time on a mobile phone.