Utilising Audio-Visual Stimuli in Interactive Information Systems: A Two Domain Investigation on Auditory Metaphors

  • Authors:
  • Affiliations:
  • Venue:
  • ITCC '02 Proceedings of the International Conference on Information Technology: Coding and Computing
  • Year:
  • 2002

Quantified Score

Hi-index 0.01

Visualization

Abstract

The paper describes experiments that investigated the use of auditory stimuli (speech and non-speech sound) to communicate data in two information systems. These experiments were performed under a multimedia stock control system and a multimedia e-mail tool. Experiments using the multimedia stock control information system investigated rhythms and timbre to communicate windows and their associated functions as well as the simultaneous use of speech and sound to communicate a large amount of information to users. Experiments using the multimedia e-mail tool investigated the use of tunes and short pitch sequences with visual stimuli to communicate information in browsing e-mail data. The paper also integrates experimental results from both systems and discusses the incorporation of auditory stimuli in interactive audio-visual or multimedia information systems. Auditory stimuli helped to communicate, complement or re-enforce information that users received via the visual channel. These auditory technologies could also benefit visually impaired users of such systems. Results also indicated that the simultaneous use of sound and speech can be useful in the design of interactive multimedia information systems. The inclusion of auditory stimuli (including speech) in the design of information systems has the potential to maximise the volume of information communicated to users. A set of empirically derived design guidelines for the auditory design of information systems are described. These guidelines include issues of presentation, classification and structure of auditory messages as part of the interface design in interactive or multimedia information systems.