3D gesture recognition: an evaluation of user and system performance

  • Authors:
  • Michael Wright;Chun-Jung Lin;Eamonn O'Neill;Darren Cosker;Peter Johnson

  • Affiliations:
  • Department of Computer Science, University of Bath, Bath, UK;Department of Computer Science, University of Bath, Bath, UK;Department of Computer Science, University of Bath, Bath, UK;Department of Computer Science, University of Bath, Bath, UK;Department of Computer Science, University of Bath, Bath, UK

  • Venue:
  • Pervasive'11 Proceedings of the 9th international conference on Pervasive computing
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We report a series of empirical studies investigating gesture as an interaction technique in pervasive computing. In our first study, participants generated gestures for given tasks and from these we identified archetypal common gestures. Furthermore, we discovered that many of these usergenerated gestures were performed in 3D. We implemented a computer vision based 3D gesture recognition system and applied it in a further study in which participants used the common gestures generated in the first study. We investigated the trade off between system performance and human performance and preferences, deriving design recommendations. We achieved 84% recognition accuracy by our prototype 3D gesture recognition system after tuning it through the use of simple heuristics. The most popular gestures from Study 1 were regarded by participants in Study 2 as best matching the task they represented, and they produced the fewest recall errors.