A framework for hand-based interaction

  • Authors:
  • Paolo Bottoni;Luigi Cinque;Marco Cupelli;Luca Di Filippo;Anna Labella;Mario Pierro;Enver Sangineto

  • Affiliations:
  • "Sapienza" University of Rome, Via Salaria, Rome, Italy;"Sapienza" University of Rome, Via Salaria, Rome, Italy;"Sapienza" University of Rome, Via Salaria, Rome, Italy;"Sapienza" University of Rome, Via Salaria, Rome, Italy;"Sapienza" University of Rome, Via Salaria, Rome, Italy;"Sapienza" University of Rome, Via Salaria, Rome, Italy;"Sapienza" University of Rome, Via Salaria, Rome, Italy

  • Venue:
  • Proceedings of the 13th International Conference on Humans and Computers
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce a framework for developing flexible, multimodal environments in which the recognition, interpretation and actuation phases are separated from one another in order to allow software modularization and component reuse. We illustrate the framework by commenting on two applications of hand-based interaction in which two different hand detection algorithms are used by the proposed system to capture users' gestures. The recognised gesture are then mapped to application-specific commands, respectively to simulate curve-drawing with a graphical tool and to steer puppet animation. We show both experimental results for the specific applications and the general platform structure. The proposed interactive applications are based on inexpensive devices (such as low-resolution WebCams) and efficient, real-time algorithms.