A design space for multimodal systems: concurrent processing and data fusion
CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Design patterns: elements of reusable object-oriented software
Design patterns: elements of reusable object-oriented software
Putting people first: specifying proper names in speech interfaces
UIST '94 Proceedings of the 7th annual ACM symposium on User interface software and technology
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
The integrality of speech in multimodal interfaces
ACM Transactions on Computer-Human Interaction (TOCHI)
A Pattern Approach to Interaction Design
A Pattern Approach to Interaction Design
Context-Sensitive Help for Multimodal Dialogue
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
An interaction constraints model for mobile and wearable computer-aided engineering systems in industrial applications
Multimodal biometrics: issues in design and testing
Proceedings of the 5th international conference on Multimodal interfaces
SmartKom mobile: intelligent ubiquitous user interaction
Proceedings of the 9th international conference on Intelligent user interfaces
The efficiency of multimodal interaction for a map-based task
ANLC '00 Proceedings of the sixth conference on Applied natural language processing
Bimodal HCI-related affect recognition
Proceedings of the 6th international conference on Multimodal interfaces
Modality fusion for graphic design applications
Proceedings of the 6th international conference on Multimodal interfaces
MATCH: an architecture for multimodal dialogue systems
ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
A conceptual framework for developing adaptive multimodal applications
Proceedings of the 11th international conference on Intelligent user interfaces
Designing Interfaces
Universal accessibility as a multimodal design issue
Communications of the ACM - ACM at sixty: a look back in time
A pattern-based methodology for multimodal interaction design
TSD'06 Proceedings of the 9th international conference on Text, Speech and Dialogue
INTETAIN'05 Proceedings of the First international conference on Intelligent Technologies for Interactive Entertainment
Identification of the User by Analyzing Human Computer Interaction
Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction
| Hi-index | 0.00 |
The context of this work is usability engineering for multimodal interaction. In contrast to other work that concentrates on prototyping toolkits or abstract guidelines, this research focuses on user interface patterns for multimodal interaction. Designing multimodal applications requires several skills ranging from design and implementation. Thus, different kinds of patterns (from architecture patterns to user interface patterns) can be applied to this field. This work focuses on user-task near user interface patterns. At first, a traditional approach of modality selection based on task- and context-based rules is presented. Next, a twofold process of pattern mining is presented. In the first phase, pattern candidates are derived top-down from proven knowledge about how multimodality enhances usability. In the second phase, literature is mined for real solutions to underpin these pattern candidates and find new ones. Along with this, relationships between patterns are depicted.