A zero-vision music recording paradigm for visually impaired people

  • Authors:
  • Thomas Haenselmann;Hendrik Lemelson;Wolfgang Effelsberg

  • Affiliations:
  • University of Mannheim, Mannheim, Germany 68159;University of Mannheim, Mannheim, Germany 68159;University of Mannheim, Mannheim, Germany 68159

  • Venue:
  • Multimedia Tools and Applications
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

At first glance, making electronic music seems to be a domain which is also well suited for people with limited eye-sight. However, a closer analysis reveals that standard software and hardware are both strongly dominated by graphical output. In order to close this gap for visually impaired musicians, we developed a MIDI (Musical Instrument Digital Interface) sequencer with audio-feedback and a new interaction paradigm which eliminates interaction with the PC's keyboard and screen. The blind musician relies solely on input via the instrument itself. He can both, record and play music via the claviature's black & white keys but at the same time control all functions of a multi-track MIDI sequencer without ever taking the hands off the instrument. We also use the MIDI-connection for coding different kinds of feedback to the user in an efficient way. The software which runs on a PC that is connected to an electronic instrument has been evaluated and improved extensively.