The multimodal music stand

Authors:
Bo Bell;Jim Kleban;Dan Overholt;Lance Putnam;John Thompson;JoAnn Kuchera-Morin
Affiliations:
Media Arts and Technology and University of California -- Santa Barbara, Santa Barbara, CA;Electrical and Computer Engineering and University of California - Santa Barbara, Santa Barbara, CA;Media Arts and Technology and University of California - Santa Barbara, Santa Barbara, CA;Media Arts and Technology and University of California - Santa Barbara, Santa Barbara, CA;Media Arts and Technology and University of California - Santa Barbara, Santa Barbara, CA;Media Arts and Technology and University of California - Santa Barbara, Santa Barbara, CA
Venue:
NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
Year:
2007

Citing 7
Cited 4

muse: a digital music stand for symphony musicians

interactions
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Performing electroacoustic music: a wider view of interactivity

Organised Sound
Communicating Expressiveness and Affect in Multimodal Interactive Systems

IEEE MultiMedia
E-mic: extended mic-stand interface controller

NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
MICON a music stand for interactive conducting

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Rethinking the Computer Music Language: SuperCollider

Computer Music Journal

The musical interface technology design space

Organised Sound
The Allobrain: An interactive, stereographic, 3D audio, immersive virtual world

International Journal of Human-Computer Studies
A multimodal system for gesture recognition in interactive music performance

Computer Music Journal
Natural, intuitive finger based input as substitution for traditional vehicle control

Proceedings of the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.