Curve shape and curvature perception through interactive sonification

Authors:
Miguel A. Alonso-Arevalo;Simon Shelley;Dik Hermes;Jacqueline Hollowood;Michael Pettitt;Sarah Sharples;Armin Kohlrausch
Affiliations:
Centro de Investigación Científica y de Educación Superior de Ensenada (CICESE), Mexico;Eindhoven University of Technology;Eindhoven University of Technology;University of Nottingham, U.K.;Everything Everywhere, U.K.;University of Nottingham, U.K.;Eindhoven University of Technology and Philips Research Eindhoven
Venue:
ACM Transactions on Applied Perception (TAP)
Year:
2012

Citing 13
Cited 0

Stereophonic and surface sound generation for exploratory data analysis

CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones

Speech Communication
Audiograf: a diagram-reader for the blind

Assets '96 Proceedings of the second annual ACM conference on Assistive technologies
An Illustrated Analysis of Sonification for Scientific Visualisation

VIS '95 Proceedings of the 6th conference on Visualization '95
Auditory information design

Auditory information design
Finding Trading Patterns in Stock Market Data

IEEE Computer Graphics and Applications
Mappings and metaphors in auditory displays: An experimental assessment

ACM Transactions on Applied Perception (TAP)
Embodied Music Cognition and Mediation Technology

Embodied Music Cognition and Mediation Technology
Access to mathematics for visually disabled students through multimodal interaction

Human-Computer Interaction
Interactive Sonification of Curve Shape and Curvature Data

HAID '09 Proceedings of the 4th International Conference on Haptic and Audio Interaction Design
Average task times in usability tests: what to report?

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Haptic and sound interface for shape rendering

Presence: Teleoperators and Virtual Environments
Geodesic Spline Interface for Haptic Curve Rendering

IEEE Transactions on Haptics

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this article we present an approach that uses sound to communicate geometrical data related to a virtual object. This has been developed in the framework of a multimodal interface for product design. The interface allows a designer to evaluate the quality of a 3-D shape using touch, vision, and sound. Two important considerations addressed in this article are the nature of the data that is sonified and the haptic interaction between the user and the interface, which in fact triggers the sound and influences its characteristics. Based on these considerations, we present a number of sonification strategies that are designed to map the geometrical data of interest into sound. The fundamental frequency of various sounds was used to convey the curve shape or the curvature to the listeners. Two evaluation experiments are described, one involves partipants with a varied background, the other involved the intended users, i.e. participants with a background in industrial design. The results show that independent of the sonification method used and independent of whether the curve shape or the curvature were sonified, the sonification was quite successful. In the first experiment participants had a success rate of about 80% in a multiple choice task, in the second experiment it took the participants on average less than 20 seconds to find the maximum, minimum or inflection points of the curvature of a test curve.