FingARtips: gesture based direct manipulation in Augmented Reality

  • Authors:
  • Volkert Buchmann;Stephen Violich;Mark Billinghurst;Andy Cockburn

  • Affiliations:
  • HIT Lab NZ;University of Canterbury, NZ;HIT Lab NZ;University of Canterbury, NZ

  • Venue:
  • Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a technique for natural, fingertip-based interaction with virtual objects in Augmented Reality (AR) environments. We use image processing software and finger- and hand-based fiducial markers to track gestures from the user, stencil buffering to enable the user to see their fingers at all times, and fingertip-based haptic feedback devices to enable the user to feel virtual objects. Unlike previous AR interfaces, this approach allows users to interact with virtual content using natural hand gestures. The paper describes how these techniques were applied in an urban planning interface, and also presents preliminary informal usability results.