AcouMotion – an interactive sonification system for acoustic motion control

Authors:
Thomas Hermann;Oliver Höner;Helge Ritter
Affiliations:
Neuroinformatics Group, Faculty of Technology, Bielefeld University, Bielefeld, Germany;Institute of Sport Science, University of Mainz, Mainz, Germany;Neuroinformatics Group, Faculty of Technology, Bielefeld University, Bielefeld, Germany
Venue:
GW'05 Proceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation
Year:
2005

Citing 2
Cited 7

Auditory Display: Sonification, Audification, and Auditory Interfaces

Auditory Display: Sonification, Audification, and Auditory Interfaces
Guest Editors' Introduction: An Introduction to Interactive Sonification

IEEE MultiMedia

3d augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support

Proceedings of the 9th international conference on Multimodal interfaces
tacTiles for Ambient Intelligence and Interactive Sonification

HAID '08 Proceedings of the 3rd international workshop on Haptic and Audio Interaction Design
Emerging sounds for disappearing computers

The disappearing computer
Embodying complexity through movement sonification: case study on empowering the speed-skater

Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction: Facing Complexity
Examining effects of acoustic feedback on perception and modification of movement patterns in on-water rowing training

Proceedings of the 6th Audio Mostly Conference: A Conference on Interaction with Sound
Methods for effective sonification of clarinetists’ ancillary gestures

GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
PhysioSonic - evaluated movement sonification as auditory feedback in physiotherapy

CMMR/ICAD'09 Proceedings of the 6th international conference on Auditory Display

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces AcouMotion as a new hard-/software system for combining human body motion, tangible interfaces and sonification to a closed-loop human computer interface that allows non-visual motor control by using sonification (non-speech auditory displays) as major feedback channel. AcouMotion's main components are (i) a sensor device for measuring motion parameters (ii) a computer simulation to represent the dynamical evolution of a model world, and (iii) a sonification engine which generates an auditory representation of objects and any interactions in the model world. The intended applications of AcouMotion range from new kinds of sport games that can be played without visual displays and therefore may be particularly interesting for people with visual impairment to further applications in data mining, physiotherapy and cognitive research. The first application of AcouMotion presented in this paper is Blindminton, a sport game similar to Badminton which is particularly adapted to the abilities of people with visual impairment. We describe our current system and its state of development, and we present first sound examples for interactive sonification using an early prototype. Finally, we discuss some interesting research directions based on the fact that AcouMotion binds auditory stimuli and body motion, and thus can represent a counterpart to the Eye-tracker device that exploits the binding of visual stimuli and eye-movement in cognitive research.