Handel, a free-hands gesture recognition system

  • Authors:
  • Leonello Tarabella

  • Affiliations:
  • computerART project of ISTI / CNR, Research Area of the Italian National Council of Research, Pisa, Italy

  • Venue:
  • CMMR'04 Proceedings of the Second international conference on Computer Music Modeling and Retrieval
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

I describe here a real-time vision-based gesture recognition system used in interactive computer music performances. The performer moves his hands in a video-camera capture area, the camera sends the signal to a video digitizer card plugged in a laptop computer. By processing the reconstructed im-ages of the performer's hands in movement the computer detects x-y positions, shape (posture) and angle of rotation of both the hands. Data extracted from image analysis every frame is used for controlling real-time interactive computer music performances. Two approaches, one more formal the other really operative, are presented.