A survey of three dialogue models
ACM Transactions on Graphics (TOG)
Statecharts: A visual formalism for complex systems
Science of Computer Programming
A generic platform for addressing the multimodal challenge
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Interaction and modeling techniques for desktop two-handed input
Proceedings of the 11th annual ACM symposium on User interface software and technology
A software model and specification language for non-WIMP user interfaces
ACM Transactions on Computer-Human Interaction (TOCHI)
Ten myths of multimodal interaction
Communications of the ACM
Direct-manipulation user interface modeling with high-level Petri nets
CSC '91 Proceedings of the 19th annual conference on Computer Science
A model-based tool for interactive prototyping of highly interactive applications
CHI '02 Extended Abstracts on Human Factors in Computing Systems
Executable UML: A Foundation for Model-Driven Architectures
Executable UML: A Foundation for Model-Driven Architectures
Prototyping Pre-implementation Designs of Virtual Environment Behaviour
EHCI '01 Proceedings of the 8th IFIP International Conference on Engineering for Human-Computer Interaction
Petri net objects for the design, validation and prototyping of user-driven interfaces
INTERACT '90 Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction
ACM '69 Proceedings of the 1969 24th national conference
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Designing Transition Networks for Multimodal VR-Interactions Using a Markup Language
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A framework for rapid development of multimodal interfaces
Proceedings of the 5th international conference on Multimodal interfaces
A model-based approach for real-time embedded multimodal systems in military aircrafts
Proceedings of the 6th international conference on Multimodal interfaces
ICARE software components for rapidly developing multimodal interfaces
Proceedings of the 6th international conference on Multimodal interfaces
Finite-state multimodal integration and understanding
Natural Language Engineering
Natural language with integrated deictic and graphic gestures
HLT '89 Proceedings of the workshop on Speech and Natural Language
A novel method for multi-sensory data fusion in multimodal human computer interaction
OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
Fusion engines for multimodal input: a survey
Proceedings of the 2009 international conference on Multimodal interfaces
DSVIS'06 Proceedings of the 13th international conference on Interactive systems: Design, specification, and verification
Usability study of multi-modal interfaces using eye-tracking
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
A formal description of multimodal interaction techniques for immersive virtual reality applications
INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
ACM Transactions on Computer-Human Interaction (TOCHI)
Une approche à base de modèles pour l'ingénierie logicielle de techniques d'interaction
Conference Internationale Francophone sur I'Interaction Homme-Machine
A model-based approach for supporting engineering usability evaluation of interaction techniques
Proceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems
Formal tasks and systems models as a tool for specifying and assessing automation designs
Proceedings of the 1st International Conference on Application and Theory of Automation in Command and Control Systems
| Hi-index | 0.00 |
Representing the behaviour of multimodal interactive systems in a complete, concise and non-ambiguous way is still a challenge for formal description techniques (FDT). Depending on the FDT, multimodal interactive systems feature specific characteristics that are either cumbersome or impossible to capture with classical FDT. This is due to the multiple (potentially synergistic) use of modalities and the strong temporal constraints usually encountered in this kind of systems that have to be dealt with exhaustively if FDT are used. This paper focuses on the requirements for the modelling and construction of fusion engines for multimodal interfaces. It proposes a formal description technique dedicated to the engineering of interactive multimodal systems able to address the challenges of fusion engines. Such benefits are presented on a set of examples illustrating both the constructs and the process.