Ten myths of multimodal interaction
Communications of the ACM
The human-computer interaction handbook
The efficiency of multimodal interaction for a map-based task
ANLC '00 Proceedings of the sixth conference on Applied natural language processing
Facilitating mobile communication with multimodal access to email messages on a cell phone
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Multimodal interaction for pedestrians: an evaluation study
Proceedings of the 10th international conference on Intelligent user interfaces
Designing Human Interface in Speech Technology
Designing Human Interface in Speech Technology
Proceedings of the 8th international conference on Multimodal interfaces
The benefits of multimodal information: a meta-analysis comparing visual and visual-tactile feedback
Proceedings of the 8th international conference on Multimodal interfaces
Usable error message presentation in the World Wide Web: Do not show errors right away
Interacting with Computers
Investigating the effectiveness of tactile feedback for mobile touchscreens
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tlk or txt? Using voice input for SMS composition
Personal and Ubiquitous Computing
Evaluation Methods for Multimodal Systems: A Comparison of Standardized Usability Questionnaires
PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
Designing and evaluating multimodal interaction for mobile contexts
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Introduction to this special issue on multimodal interfaces
Human-Computer Interaction
Audio or tactile feedback: which modality when?
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Vibratory and Acoustical Factors in Multimodal Reproduction of Concert DVDs
HAID '09 Proceedings of the 4th International Conference on Haptic and Audio Interaction Design
Audiotactile Feedback Design for Touch Screens
HAID '09 Proceedings of the 4th International Conference on Haptic and Audio Interaction Design
Crosstrainer: testing the use of multimodal interfaces in situ
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Clutching at straws: using tangible interaction to provide non-visual access to graphs
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Managing workload in human-robot interaction: A review of empirical studies
Computers in Human Behavior
Designing spatial audio interfaces to support multiple audio streams
Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Benchmarks for intuitive interaction with mobile devices
Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Editorial: Inclusion and interaction: Designing interaction for inclusive populations
Interacting with Computers
The impact of unwanted multimodal notifications
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Temporal binding of multimodal controls for dynamic map displays: a systems approach
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Game controllers for older adults: experimental study on gameplay experiences and preferences
Proceedings of the International Conference on the Foundations of Digital Games
Designing multimodal reminders for the home: pairing content with presentation
Proceedings of the 14th ACM international conference on Multimodal interaction
Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Designing a smartpen reminder system for older adults
CHI '13 Extended Abstracts on Human Factors in Computing Systems
3D Virtual worlds and the metaverse: Current status and future possibilities
ACM Computing Surveys (CSUR)
Hi-index | 0.00 |
The major promise of multimodal user interfaces for older users is that they have the choice to select the input modality (or combination of modalities) that best fits their needs and capabilities. Two studies investigated if multimodal interfaces with touch, speech, and motion control fulfil the expectation of being superior to the interaction with single modalities in a mobile device regarding efficiency, robustness, and user satisfaction. The results of both studies show a superiority of multimodality over the single modalities speech and motioncontrol and a slight advantage over touch, which was the modality most frequently used even in the multimodal condition in which any modality or a modality combination could be chosen. Differences between old and young users were only shown for motion control which turned out to be less suitable for older people. The major promise of multimodality for inclusive design thus does not seem warranted so far. However, other applications and contexts of use need to be investigated.