Leveraging behavioral models of sounding objects forgesture-controlled sound design

Authors:
Kristian Gohlke;David Black;Jörn Loviscach
Affiliations:
University of Applied Sciences Bremen, Bremen, Germany;University of Applied Sciences Bremen, Bremen, Germany;University of Applied Sciences, Bielefeld, Germany
Venue:
Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Year:
2010

Citing 10
Cited 0

Control parameters for musical instruments: a foundation for new mappings of gesture to sound

Organised Sound
Principles for designing computer music controllers

NIME '01 Proceedings of the 2001 conference on New interfaces for musical expression
PebbleBox and CrumbleBag: tactile interfaces for granular synthesis

NIME '04 Proceedings of the 2004 conference on New interfaces for musical expression
Gesture and musical interaction: interactive engagement through dynamic morphology

NIME '04 Proceedings of the 2004 conference on New interfaces for musical expression
A theory of modulated objects for new shamanic controller design

NIME '04 Proceedings of the 2004 conference on New interfaces for musical expression
Experiments with virtual reality instruments

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
PHYSMISM: a control interface for creative exploration of physical models

NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
The Thummer Mapping Project (ThuMP)

NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
Don't forget the laptop: using native input capabilities for expressive musical control

NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
MAGIC: a motion gesture design tool

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Sound designers and Foley artists have long struggled to create expressive soundscapes using standard editing software, devoting much time for the calibration of multiple sound samples and parameter adjustments. We present an intuitive approach that exploits the capabilities of off-theshelf motion-sensing input devices to enable quick and fluid interaction with sound to trigger and modulate digital sound generators based on adaptable behavioral models of familiar physical sounding objects. Rather than requiring profound technical knowledge of sound design, the system leverages the user's motor memory and motion skills to mimic generic and familiar interactions with everyday sounding objects. This allows the user to fully focus on the expressive act of sound creation while enjoying a fluent workflow and a satisfying user experience.