Design of a touchless multipoint musical interface in a virtual studio environment

  • Authors:
  • Dionysios Marinos;Björn Wöldecke;Chris Geiger;Tobias Schwirten

  • Affiliations:
  • University of Applied Sciences Düsseldorf, Düsseldorf, Germany;University of Applied Sciences Düsseldorf, Düsseldorf, Germany;University of Applied Sciences Düsseldorf, Düsseldorf, Germany;Lang AG, Lindlar, Germany

  • Venue:
  • Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we describe a system for creating live musical expressions in a virtual studio environment. The underlying concept of this work is to provide casual and semi-professional users with a user experience that allow to easily create musical expressions without touch and visible feedback similar to the Theremin approach invented in in the early 20th century by Lev Theremin [26]. One or more performers stand in front of a studio camera inside a blue box and interact with an infrared-laser-based multi-touch device. The final TV image shows the performers interacting with a virtual screen, which is augmented in front of them, and background scenery that dynamically reacts to the music being produced. To overcome the problem of the performers not seeing this virtual screen in reality and yet being able to play melodic sequences, we use a special hexagonal pitch grid to facilitate the performer's awareness of this novel thereminlike virtual musical instrument.