An audio-haptic interface based on auditory depth cues

Authors:
Delphine Devallez;Federico Fontana;Davide Rocchesso
Affiliations:
University of Verona, Verona, Italy;University of Verona, Verona, Italy;IUAV of Venice, Venice, Italy
Venue:
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Year:
2008

Citing 8
Cited 0

Extending the Notion of a Window System to Audio

Computer
A generic direct-manipulation 3D-auditory environment for hierarchical navigation in non-visual interaction

Assets '96 Proceedings of the second annual ACM conference on Assistive technologies
Audio hallway: a virtual acoustic environment for browsing

Proceedings of the 11th annual ACM symposium on User interface software and technology
Multimodal 'eyes-free' interaction techniques for wearable devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Designing accessible auditory drag and drop

CUU '03 Proceedings of the 2003 conference on Universal usability
Understanding concurrent earcons: Applying auditory scene analysis principles to concurrent earcon recognition

ACM Transactions on Applied Perception (TAP)
After direct manipulation---direct sonification

ACM Transactions on Applied Perception (TAP)
Building low-cost music controllers

CMMR'05 Proceedings of the Third international conference on Computer Music Modeling and Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

Spatialization of sound sources in depth allows a hierarchical display of multiple audio streams and therefore may be an efficient tool for developing novel auditory interfaces. In this paper we present an audio-haptic interface for audio browsing based on rendering distance cues for ordering sound sources in depth. The haptic interface includes a linear position tactile sensor made by conductive material. The touch position on the ribbon is mapped onto the listening position on a rectangular virtual membrane, modeled by a bidimensional Digital Waveguide Mesh and providing distance cues of four equally spaced sound sources. Furthermore a knob of a MIDI controller controls the position of the mesh along the playlist, which allows to browse the whole set of files. Subjects involved in a user study found the interface intuitive and entertaining. In particular the interaction with the stripe was highly appreciated.