Interactive 3D Model Acquisition and Tracking of Building Block Structures

  • Authors:
  • Andrew Miller;Brandyn White;Emiko Charbonneau;Zach Kanzler;Joseph J. LaViola Jr.

  • Affiliations:
  • University of Central Florida;University of Central Florida;University of Central Florida;University of Central Florida;University of Central Florida

  • Venue:
  • IEEE Transactions on Visualization and Computer Graphics
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a prototype system for interactive construction and modification of 3D physical models using building blocks.Our system uses a depth sensing camera and a novel algorithm for acquiring and tracking the physical models. The algorithm,Lattice–First, is based on the fact that building block structures can be arranged in a 3D point lattice where the smallest block unitis a basis in which to derive all the pieces of the model. The algorithm also makes it possible for users to interact naturally with thephysical model as it is acquired, using their bare hands to add and remove pieces. We present the details of our algorithm, along withexamples of the models we can acquire using the interactive system. We also show the results of an experiment where participantsmodify a block structure in the absence of visual feedback. Finally, we discuss two proof–of–concept applications: a collaborativeguided assembly system where one user is interactively guided to build a structure based on another user’s design, and a gamewhere the player must build a structure that matches an on–screen silhouette.