Effects of spectral features of sound on gesture type and timing

Authors:
Mariusz Kozak;Kristian Nymoen;Rolf Inge Godøy
Affiliations:
fourMs, University of Oslo, Norway,Department of Music, University of Chicago, Chicago;fourMs, University of Oslo, Norway;fourMs, University of Oslo, Norway
Venue:
GW'11 Proceedings of the 9th international conference on Gesture and Sign Language in Human-Computer Interaction and Embodied Communication
Year:
2011

Citing 8
Cited 2

Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Gestural-Sonorous Objects: embodied extensions of Schaeffer's conceptual apparatus

Organised Sound
Rhythm and Beat Perception in Motor Areas of the Brain

Journal of Cognitive Neuroscience
Semiotics of Sounds Evoking Motions: Categorization and Acoustic Features

Computer Music Modeling and Retrieval. Sense of Sounds
Rhythm and Transforms

Rhythm and Transforms
Playing “air instruments”: mimicry of sound-producing gestures by novices and experts

GW'05 Proceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation
Towards a gesture-sound cross-modal analysis

GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
A statistical approach to analyzing sound tracings

CMMR'11 Proceedings of the 8th international conference on Speech, Sound and Music Processing: embracing research in India

A statistical approach to analyzing sound tracings

CMMR'11 Proceedings of the 8th international conference on Speech, Sound and Music Processing: embracing research in India
Analyzing correspondence between sound objects and body motion

ACM Transactions on Applied Perception (TAP)

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present results from an experiment in which infrared motion capture technology was used to record participants' movement in synchrony to different rhythms and different sounds. The purpose was to determine the effects of the sounds' spectral and temporal features on synchronization and gesture characteristics. In particular, we focused on the correlation between sounds and three gesture features: maximum acceleration, discontinuity, and total quantity of motion. Our findings indicate that discrete, discontinuous motion resulted in better synchronization, while spectral features of sound had a significant effect on the quantity of motion.