ESP: a driving interface for Expression Synthesis

  • Authors:
  • Elaine Chew;Alexandre François;Jie Liu;Aaron Yang

  • Affiliations:
  • University of Southern California, Los Angeles CA;University of Southern California, Los Angeles CA;University of Southern California, Los Angeles CA;University of Southern California, Los Angeles CA

  • Venue:
  • NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the Expression Synthesis Project (ESP), we propose a driving interface for expression synthesis. ESP aims to provide a compelling metaphor for expressive performance so as to make high-level expressive decisions accessible to non-experts. In ESP, the user drives a car on a virtual road that represents the music with its twists and turns; and makes decisions on how to traverse each part of the road. The driver's decisions affect in real-time the rendering of the piece. The pedals and wheel provide a tactile interface for controlling the car dynamics and musical expression, while the display portrays a first person view of the road and dashboard from the driver's seat. This game-like interface allows non-experts to create expressive renderings of existing music without having to master an instrument, and allows expert musicians to experiment with expressive choice without having to first master the notes of the piece. The prototype system has been tested and refined in numerous demonstrations. This paper presents the concepts underlying the ESP system and the architectural design and implementation of a prototype.