Statecharts: A visual formalism for complex systems
Science of Computer Programming
InTml: a description language for VR applications
Proceedings of the seventh international conference on 3D Web technology
Support for input adaptability in the ICON toolkit
Proceedings of the 6th international conference on Multimodal interfaces
Multisensory interaction metaphors with haptics and proprioception in virtual environments
Proceedings of the third Nordic conference on Human-computer interaction
The openinterface framework: a tool for multimodal interaction.
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Utilizing Dynamic Executable Models for User Interface Development
Interactive Systems. Design, Specification, and Verification
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Human Machine Interaction
Comparing NiMMiT and data-driven notations for describing multimodal interaction
TAMODIA'06 Proceedings of the 5th international conference on Task models and diagrams for users interface design
A formal description of multimodal interaction techniques for immersive virtual reality applications
INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
Engineering device-spanning, multimodal web applications using a model-based design approach
Proceedings of the 18th Brazilian symposium on Multimedia and the web
| Hi-index | 0.00 |
With new sensors that can capture hand and body movements in 3D, novel interaction techniques gain importance. But development of new forms of interaction is highly iterative, depends on extensive user testing and therefore is expensive. We propose a model-based notation using statecharts and mappings to ease multimodal interaction technique design. This model-based specification can be used to communicate designs, for evaluation and to enable re-use. Our contribution continues previous research on model-based interaction technique design considers multimodal interaction and addresses problems like the state explosion, error management and consideration of output modalities mentioned by earlier research. We evaluate our notation by comparing it with NiMMiT referring to the same use case to identify similarities, strength and problems.