A leap-supported, hybrid AR interface approach

  • Authors:
  • Holger Regenbrecht;Jonny Collins;Simon Hoermann

  • Affiliations:
  • University of Otago, Dunedin, New Zealand;University of Otago, Dunedin, New Zealand;University of Otago, Dunedin, New Zealand

  • Venue:
  • Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel interface approach which combines 2D video-based AR with a partial voxel model, allowing for more convincing interactions with 3D objects and worlds. It enables users in a hand-controlled interface (a) to interact with a virtual environment (VE) and at the same time (b) allows for correct mutual occlusions between interacting fingers and the VE. A Leap Motion Controller is used to track the users' fingers and a webcam overlay allows for an augmented view. Our "VoxelAR" concept can be applied in modified ways to any video see-through AR system; we demonstrate our approach in a physical rehabilitation application scenario. Our prototype implementation and our work-in-progress findings are presented.