Gestural attributions as semantics in user interface sound design

Authors:
Kai Tuuri
Affiliations:
Department of Computer Science and Information Systems, University of Jyväskylä, Finland
Venue:
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Year:
2009

Citing 3
Cited 1

Gestural-Sonorous Objects: embodied extensions of Schaeffer's conceptual apparatus

Organised Sound
Embodied Music Cognition and Mediation Technology

Embodied Music Cognition and Mediation Technology
Sonic interaction design: sound, information and experience

CHI '08 Extended Abstracts on Human Factors in Computing Systems

Leaping across modalities: speed regulation messages in audio and tactile domains

HAID'10 Proceedings of the 5th international conference on Haptic and audio interaction design

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper proposes a gesture-based approach to user interface sound design, which utilises projections of body movements in sounds as meaningful attributions. The approach is founded on embodied conceptualisation of human cognition and it is justified through a literature review on the subject of interpersonal action understanding. According to the resulting hypothesis, stereotypical gestural cues, which correlate with, e.g., a certain communicative intention, represent specific non-linguistic meanings. Based on this theoretical framework, a model of a process is also outlined where stereotypical gestural cues are implemented in sound design.