Between Mapping, Sonification and Composition: Responsive Audio Environments in Live Performance

  • Authors:
  • Christopher L. Salter;Marije A. Baalman;Daniel Moody-Grigsby

  • Affiliations:
  • Design and Computation Arts, Concordia University, Montréal, Canada and Interactive Performance and Sound, Hexagram Institute, Montréal, Canada;Design and Computation Arts, Concordia University, Montréal, Canada and Institute for Audio Communication, Technische Universität Berlin, Berlin, Germany;Design and Computation Arts, Concordia University, Montréal, Canada

  • Venue:
  • Computer Music Modeling and Retrieval. Sense of Sounds
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes recent work on a large-scale, interactive dance theater performance entitled Schwelleas a platform to pose critical questions around the conception, design and implementation of what is commonly labeled responsive audio environments. The authors first discuss some principal issues in the design of responsive audio environments specifically within the domain of stage performance, addressing existing human-computer interaction paradigms in three key areas: sensing, mapping and data sonification. Next, we explore larger questions of composition in relation to these key areas, suggesting that potential strategies cross three different domains: mapping within algorithmic composition, data sonification techniques, and time-based evolutionary processes emerging from dynamical systems theory. We then examine recent work on Schwelle, which employs real time, distributed sensor data to drive a continuous dynamical system-based composition engine. The project's conceptual and technical challenges are discussed as well as audience evaluation and feedback from the first presentation in Berlin in February 2007, and the subsequent revisions for the second presentation in Montréal in May 2007. Finally, the paper concludes with a set of issues that may act as a framework for future research focused on compositional strategies for larger scale, distributed, network-based sensor environments.