International Journal of Man-Machine Studies
Modeling error recovery and repair in automatic speech recognition
International Journal of Man-Machine Studies
ISSD-93 Selected papers presented at the international symposium on Spoken dialogue
Integration and synchronization of input modes during multimodal human-computer interaction
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Synchronization of speech and hand gestures during multimodal human-computer interaction
CHI 98 Cconference Summary on Human Factors in Computing Systems
Patterns of entry and correction in large vocabulary continuous speech recognition systems
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Model-based and empirical evaluation of multimodal interactive error correction
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Ten myths of multimodal interaction
Communications of the ACM
Charting past, present, and future research in ubiquitous computing
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction in the new millennium, Part 1
Taming recognition errors with a multimodal interface
Communications of the ACM
SATIN: a toolkit for informal ink-based applications
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Multimodal error correction for speech user interfaces
ACM Transactions on Computer-Human Interaction (TOCHI)
Towards reliable multimodal sensing in aware environments
Proceedings of the 2001 workshop on Perceptive user interfaces
Presiding over accidents: system direction of human action
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal affect recognition in learning environments
Proceedings of the 13th annual ACM international conference on Multimedia
Encyclopedia of Multimedia Technology and Networking
Encyclopedia of Multimedia Technology and Networking
Signal Processing - Special section: Multimodal human-computer interfaces
The Role of Iconic Gestures in Speech Disambiguation: ERP Evidence
Journal of Cognitive Neuroscience
User-Centred Development of Mobile Interfaces to a Pervasive Computing Environment
ACHI '08 Proceedings of the First International Conference on Advances in Computer-Human Interaction
Active authentication for pervasive computing environments
ISSS'02 Proceedings of the 2002 Mext-NSF-JSPS international conference on Software security: theories and systems
More principled design of pervasive computing systems
EHCI-DSVIS'04 Proceedings of the 2004 international conference on Engineering Human Computer Interaction and Interactive Systems
Spatiotemporal salient points for visual recognition of human actions
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Middleware for pervasive computing: A survey
Pervasive and Mobile Computing
| Hi-index | 0.25 |
Multimodal interaction can improve accessibility to pervasive computing applications. However, recognition-based interaction techniques used in multimodal interfaces (e.g. speech and gesture recognition) are still error prone. Recognition errors and misinterpretations can compromise the security, robustness, and efficiency of pervasive computing applications. In this paper we briefly review the various error handling strategies that can be found in the multimodal literature. We then discuss the new challenges arising from novel affective and context-aware applications for error correction. We show that traditional multimodal error handling strategies are ill adapted to pervasive computing applications, where the computing devices have become invisible, and when users may not be aware of their own behaviour. Finally, we present an original experimental study into users' synchronisation of speech and pen inputs in error correction. The results of the study suggest that users are likely to modify their synchronisation patterns in the belief that it can help error resolution. This study is a first step towards a better understanding of spontaneous user strategies for error correction in multimodal interfaces and pervasive environments.