A virtual protocol model for computer-human interaction
International Journal of Man-Machine Studies
Modeling and forecasting the information sciences
Information Sciences: an International Journal - Special issue on information sciences—past, present, and future
User and discourse models for multimodal communication
Intelligent user interfaces
Integrating simultaneous input from speech, gaze, and hand gestures
Intelligent multimedia interfaces
A design space for multimodal systems: concurrent processing and data fusion
INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
A generic platform for addressing the multimodal challenge
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Maintaining knowledge about temporal intervals
Communications of the ACM
Developing Multimodal Interfaces: A Theoretical Framework and Guided Propagation Networks
Multimodal Human-Computer Communication, Systems, Techniques, and Experiments
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Designing Transition Networks for Multimodal VR-Interactions Using a Markup Language
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A framework for rapid development of multimodal interfaces
Proceedings of the 5th international conference on Multimodal interfaces
ICARE: a component-based approach for the design and development of multimodal interfaces
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Modality fusion for graphic design applications
Proceedings of the 6th international conference on Multimodal interfaces
Proceedings of the 6th international conference on Multimodal interfaces
ICARE software components for rapidly developing multimodal interfaces
Proceedings of the 6th international conference on Multimodal interfaces
Context based multimodal fusion
Proceedings of the 6th international conference on Multimodal interfaces
Finite-state multimodal integration and understanding
Natural Language Engineering
Natural language with integrated deictic and graphic gestures
HLT '89 Proceedings of the workshop on Speech and Natural Language
A conceptual framework for developing adaptive multimodal applications
Proceedings of the 11th international conference on Intelligent user interfaces
From vocal to multimodal dialogue management
Proceedings of the 8th international conference on Multimodal interfaces
Multimodal fusion: a new hybrid strategy for dialogue systems
Proceedings of the 8th international conference on Multimodal interfaces
A novel method for multi-sensory data fusion in multimodal human computer interaction
OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
Multimodal human-computer interaction: A survey
Computer Vision and Image Understanding
Gesture recognition with a Wii controller
Proceedings of the 2nd international conference on Tangible and embedded interaction
Proceedings of the 2nd international conference on Tangible and embedded interaction
A formal description of multimodal interaction techniques for immersive virtual reality applications
INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
Proceedings of the 2009 international conference on Multimodal interfaces
Self-checking widgets for interactive cockpits
EWDC '11 Proceedings of the 13th European Workshop on Dependable Computing
A model-based approach for supporting engineering usability evaluation of interaction techniques
Proceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems
UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: design for all and eInclusion - Volume Part I
Mudra: a unified multimodal interaction framework
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Exploiting gaming research and practice for engineering interactive critical systems
Proceedings of the 1st International Conference on Application and Theory of Automation in Command and Control Systems
Fusion in multimodal interactive systems: an HMM-based algorithm for user-induced adaptation
Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems
Modeling multimodal integration with event logic charts
Proceedings of the 14th ACM international conference on Multimodal interaction
KI'12 Proceedings of the 35th Annual German conference on Advances in Artificial Intelligence
GlueTK: a framework for multi-modal, multi-display human-machine-interaction
Proceedings of the 2013 international conference on Intelligent user interfaces
Formal description of multi-touch interactions
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
Tuning an HCI curriculum for master students to address interactive critical systems aspects
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I
Review Article: Multimodal interaction: A review
Pattern Recognition Letters
| Hi-index | 0.00 |
Fusion engines are fundamental components of multimodal inter-active systems, to interpret input streams whose meaning can vary according to the context, task, user and time. Other surveys have considered multimodal interactive systems; we focus more closely on the design, specification, construction and evaluation of fusion engines. We first introduce some terminology and set out the major challenges that fusion engines propose to solve. A history of past work in the field of fusion engines is then presented using the BRETAM model. These approaches to fusion are then classified. The classification considers the types of application, the fusion principles and the temporal aspects. Finally, the challenges for future work in the field of fusion engines are set out. These include software frameworks, quantitative evaluation, machine learning and adaptation.