Meaningful melodies: personal sonification of text messages for mobile devices

  • Authors:
  • Bastian Pfleging;Florian Alt;Albrecht Schmidt

  • Affiliations:
  • University of Stuttgart, Stuttgart, Germany;University of Stuttgart, Stuttgart, Germany;University of Stuttgart, Stuttgart, Germany

  • Venue:
  • MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Mobile phones offer great potential for personalization. Besides apps and background images, ringtones are the major form of personalization. They are most often used to have a personal sound for incoming texts and calls. Furthermore, ringtones are used to identify the caller or sender of a message. In parts, this function is utilitarian (e.g., caller identification without looking at the phone) but it is also a form of self-expression (e.g., favorite tune as standard ringtone). We investigate how audio can be used to convey richer information. In this demo we show how sonifications of SMS can be used to encode information about the sender's identity as well as the content and intention of a message based on flexible, user-generated mappings. We present a platform that allows arbitrary mappings to be managed and apps to be connected in order to create a sonification of any message. Using a background app on Android, we show the utility of the approach for mobile devices.