SoniMime: movement sonification for real-time timbre shaping

Authors:
Jesse Fox;Jennifer Carlile
Affiliations:
Stanford University;Stanford University
Venue:
NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Year:
2005

Citing 1
Cited 1

Glove-TalkII-a neural-network interface which maps gestures to parallel formant speech synthesizer controls

IEEE Transactions on Neural Networks

Open Sound Control: an enabling technology for musical networking

Organised Sound

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes the design of SoniMime, a system for the sonification of hand movement for real-time timbre shaping. We explore the application of the tristimulus timbre model for the sonification of gestural data, working toward the goals of musical expressivity and physical responsiveness. SoniMime uses two 3-D accelerometers connected to an Atmel microprocessor which outputs OSC control messages. Data filtering, parameter mapping, and sound synthesis take place in Pd running on a Linux computer.