Gesture Control of Sound Spatialization for Live Musical Performance

Authors:
Mark T. Marshall;Joseph Malloch;Marcelo M. Wanderley
Affiliations:
Input Devices and Music Interaction Laboratory Centre for Interdisciplinary Research in Music Media and Technology Music Technology Area, McGill University, Montreal, Canada;Input Devices and Music Interaction Laboratory Centre for Interdisciplinary Research in Music Media and Technology Music Technology Area, McGill University, Montreal, Canada;Input Devices and Music Interaction Laboratory Centre for Interdisciplinary Research in Music Media and Technology Music Technology Area, McGill University, Montreal, Canada
Venue:
Gesture-Based Human-Computer Interaction and Simulation
Year:
2009

Citing 8
Cited 1

Integrality and separability of input devices

ACM Transactions on Computer-Human Interaction (TOCHI)
Human-computer interaction: toward the year 2000

Human-computer interaction: toward the year 2000
Principles for designing computer music controllers

NIME '01 Proceedings of the 2001 conference on New interfaces for musical expression
A VR interface for collaborative 3D audio performance

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
The ZKM Klangdom

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
A framework for immersive spatial audio performance

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Gesture control of sounds in 3D space

NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
WAVE: Sound and music in an immersive environment

Computers and Graphics

Perceptual impact of gesture control of spatialization

ACM Transactions on Applied Perception (TAP)

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the development of methods for gesture control of sound spatialization. It provides a comparison of seven popular software spatialization systems from a control point of view, and examines human-factors issues relevant to gesture control. An effort is made to reconcile these two design- and parameter-spaces, and draw useful conclusions regarding likely successful mapping strategies. Lastly, examples are given using several different gesture-tracking and motion capture systems controlling various parameters of the spatialization system.