Real-time cloud-based 3D reconstruction and interaction with a stereo smartphone

  • Authors:
  • Yanhui Hong;Lifeng Sun;Keyin Tang;Yijing Li

  • Affiliations:
  • Tsinghua University;Tsinghua University;Tsinghua University;Tsinghua University

  • Venue:
  • Proceedings of the 5th ACM Multimedia Systems Conference
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this demonstration, we present a novel cloud-based system for casual users, which enables real-time 3D reconstruction and interaction based on stereo smartphones. The client is an Android application that captures scene in real-world, displays reconstructed 3D model and supports interaction. The server receives captured data from client and reconstructs 3D model in real-time. While users capturing data, both the reconstructed scenes and the marked uncertainty regions are visualized on the phones. So, it allows users to continuously update the reconstructed model in real-time by interaction. Meanwhile our system is implemented based on smartphones, which are accessible to casual users, while many existing systems always require extra or expensive specialized equipment. Also, we proposed multiple innovative methods to achieve continuously repairing model through interaction and address the challenge brought by the phone hardware limitations.