Ten myths of multimodal interaction
Communications of the ACM
Auditory Display: Sonification, Audification, and Auditory Interfaces
Auditory Display: Sonification, Audification, and Auditory Interfaces
| Hi-index | 0.00 |
This paper presents the design and evaluation of a new type of mixed-modal auditory display for enhancing auditory sensation. The purpose of this study is to determine whether or not a light apparatus in which LED lights are installed in front of a speaker panel and alternating lights based on sound frequency and intensity can support user awareness of the auditory source. Five different auditory sources were used, and a user study with 20 participants revealed that all auditory sources were better recognized when listened to with the light apparatus. The music and the emergency alert auditory source were best represented by the light apparatus. The experiment showed synchronized visual and audio representation enhanced the user's auditory sensation. Findings suggest that the light apparatus could be useful when auditory signal displays are not universally applicable because people who suffer from hearing loss are unable to use them effectively. It is expected that the result of this study could contribute to the design of hearing aids, emergency alarm device/mechanisms, communication trust or other assistive technologies that seek to provide context to received data.