Methods for effective sonification of clarinetists’ ancillary gestures

Authors:
Florian Grond;Thomas Hermann;Vincent Verfaille;Marcelo M. Wanderley
Affiliations:
Ambient Intelligence Group, CITEC, Bielefeld University;Ambient Intelligence Group, CITEC, Bielefeld University;IDMIL, CIRMMT, McGill University;IDMIL, CIRMMT, McGill University
Venue:
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Year:
2009

Citing 3
Cited 0

Quantitative Analysis of Non-obvious Performer Gestures

GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Movement Sonification: Effects on Perception and Action

IEEE MultiMedia
AcouMotion – an interactive sonification system for acoustic motion control

GW'05 Proceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present the implementation of two different sonifications methods of ancillary gestures from clarinetists. The sonifications are data driven from the clarinetist’s posture which is captured with a VICON motion tracking system. The first sonification method is based on the velocities of the tracking markers, the second method involves a principal component analysis as a data preprocessing step. Further we develop a simple complementary visual display with a similar information content to match the sonification. The effect of the two sonifications with respect to the movement perception is studied in an experiment where test subjects annotate the clarinetists performance represented by various combinations of the resulting uni- and multimodal displays.