Pointing fingers: using multiple direct interactions with visual objects to perform music

  • Authors:
  • Jean-Michel Couturier;Daniel Arfib

  • Affiliations:
  • LMA-CNRS, chemin Joseph Aiguier, France;LMA-CNRS, chemin Joseph Aiguier, France

  • Venue:
  • NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we describe a new interface for musical performance, using the interaction with a graphical user interface in a powerful manner: the user directly touches a screen where graphical objects are displayed and can use several fingers simultaneously to interact with the objects. The concept of this interface is based on the superposition of the gesture spatial place and the visual feedback spatial place; it gives the impression that the graphical objects are real. This concept enables a huge freedom in designing interfaces. The gesture device we have created gives the position of four fingertips using 3D sensors and the data is performed in the Max/MSP environment. We have realized two practical examples of musical use of such a device, using Photosonic Synthesis and Scanned Synthesis.