The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids

  • Authors:
  • Melanie Baljko

  • Affiliations:
  • York University, Toronto, Canada

  • Venue:
  • ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

For computational Augmentative and Alternative Communication (AAC) aids, it has often been asserted that multimodal interfaces have benefits over unimodal ones. Several such benefits have been described informally, but, to date, few have actually been formalized or quantified. In this paper, some of the special considerations of this application domain are described. Next, the hypothesized benefits of semantically nonredundant multimodal input actions over unimodal input actions are described formally. The notion of information rate, already well established as a dependent variable in evaluations of AAC devices, is quantified in this paper, using the formalisms provided by Information Theory (as opposed to other, idiosyncratic approaches that have been employed previously). A comparative analysis was performed between interfaces that afford unimodal input actions and those that afford semantically nonredundant multimodal input actions. This analysis permitted generalized conclusions, which have been synthesized with those of another, recently-completed analysis in which unimodal and semantically redundant multimodal input actions were compared. A reinterpretation of Keates and Robinson's empirical data (1998) shows that their criticism of multimodal interfaces for AAC devices, in part, was unfounded.