Ten myths of multimodal interaction
Communications of the ACM
The human-computer interaction handbook
Exploring multimodality in the laboratory and the field
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Tlk or txt? Using voice input for SMS composition
Personal and Ubiquitous Computing
Multimodal Interaction: Real Context Studies on Mobile Digital Artefacts
HAID '08 Proceedings of the 3rd international workshop on Haptic and Audio Interaction Design
Explorative studies on multimodal interaction in a PDA- and desktop-based scenario
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Future mobile health systems: designing personal mobile applications to assist self diagnosis
BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2
Multimodal interaction: A suitable strategy for including older users?
Interacting with Computers
| Hi-index | 0.00 |
This paper reports on a user trial (N=17) that compares the use of two systems for accessing email messages on a telephone handset. The first system uses graphic output and telephone keypad input, while the second system has both graphic and speech output, with keypad and speech as input. To our knowledge, this trial represents the first evaluation of a fully functioning multimodal system that uses natural language understanding on a phone, and was dependent on the 3G network currently available in Australia. Participants saw significantly greater value in the multimodal interaction, and rated their experience with the multimodal system significantly more positively than the unimodal system. They were also significantly more inclined to use and recommend the multimodal system over the current unimodal product offering. While we expected to see some mixed usage of modalities in the multimodal system, participants used speech predominantly, falling back to GUI selection only after encountering multiple speech recognition failures in a row.