QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
An Experimental Study of Input Modes for Multimodal Human-Computer Interaction
ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces
Synergy Effects in Natural Language-Based Multimodal Interaction
Synergy Effects in Natural Language-Based Multimodal Interaction
Combining speech and haptics for intuitive and efficient navigation through image databases
Proceedings of the 5th international conference on Multimodal interfaces
Evaluation of spoken multimodal conversation
Proceedings of the 6th international conference on Multimodal interfaces
A method to standardize usability metrics into a single score
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Meta-analysis of correlations among usability measures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Reliable Evaluation of Multimodal Dialogue Systems
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Usability Evaluation of Multimodal Interfaces: Is the Whole the Sum of Its Parts?
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Usability study of multi-modal interfaces using eye-tracking
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
| Hi-index | 0.00 |
With variety of interaction technologies like speech, pen, touch, hand or body gestures, eye gaze, etc., being now available for users, it is a challenge to design optimal and effective multimodal combinations for specific tasks. For designing that, it is important to understand how these modalities can be combined and used in a coordinated manner. We performed an experimental evaluation of combinations of different multimodal inputs, such as keyboard, speech and touch with pen etc, in an attempt to investigate, which combinations are efficient for diverse needs of the users. In our study, multimodal combination of three modalities was found to be more effective in terms of performance, accuracy and user experience than that of two modalities. Further, we also inferred the roles that each of the modalities play in a multimodal combination to achieve the usability goals.