Gestural control of music: using the vicon 8 motion capture system

Authors:
Christopher Dobrian;Frédéric Bevilacqua
Affiliations:
University of California, Irvine, Irvine, CA;University of California, Irvine, Irvine, CA
Venue:
NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
Year:
2003

Citing 0
Cited 6

Connecting strangers at a train station

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
The 'E' in NIME: musical expression with new computer interfaces

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
A Camera-Based Music-Making Tool for Physical Rehabilitation

Computer Music Journal
Preservation of interactive multimedia performances

International Journal of Metadata, Semantics and Ontologies
Motion scoring

ACM SIGGRAPH 2010 Posters
HandSonor: a customizable vision-based control interface for musical expression

CHI '13 Extended Abstracts on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This article reports on a project that uses unfettered gestural motion for expressive musical purposes. The project involves the development of, and experimentation with, software to receive data from a Vicon motion capture system, and to translate and map that data into data for the control of music and other media such as lighting. In addition to the commercially standard MIDI---which allows direct control of external synthesizers, processors, and other devices---other mappings are used for direct software control of digital audio and video. This report describes the design and implementation of the software, discusses specific experiments performed with it, and evaluates its application in terms of aesthetic pros and cons.