Statecharts: A visual formalism for complex systems
Science of Computer Programming
AVI '94 Proceedings of the workshop on Advanced visual interfaces
CTTE: support for developing and analyzing task models for interactive system design
IEEE Transactions on Software Engineering
Addressing the mapping problem in user interface design with UsiXML
TAMODIA '04 Proceedings of the 3rd annual conference on Task models and diagrams
Gummy for multi-platform user interface designs: shape me, multiply me, fix me, use me
AVI '08 Proceedings of the working conference on Advanced visual interfaces
COMET(s), A Software Architecture Style and an Interactors Toolkit for Plastic User Interfaces
Interactive Systems. Design, Specification, and Verification
Executable Models for Human-Computer Interaction
Interactive Systems. Design, Specification, and Verification
A Structured Approach to Support 3D User Interface Development
ACHI '09 Proceedings of the 2009 Second International Conferences on Advances in Computer-Human Interactions
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Human Machine Interaction
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
The WebTaskModel approach to web process modelling
TAMODIA'07 Proceedings of the 6th international conference on Task models and diagrams for user interface design
Building multimodal interfaces out of executable, model-based interactors and mappings
HCII'11 Proceedings of the 14th international conference on Human-computer interaction: design and development approaches - Volume Part I
Comparing the multimodal interaction technique design of MINT with NiMMiT
Proceedings of the 19th Brazilian symposium on Multimedia and the web
| Hi-index | 0.00 |
Nowadays the web is an ubiquitously available source of information that can be accessed through a broad range of devices, such as smart phones, tablets and notebooks. Although web applications can be used through several devices, they are controlled and designed for a one-to-one connection type of interaction, which prevents device-spanning multi-modal interactions. We propose a model-based run-time framework to design and execute multi-modal interfaces for the web. Different to a model-based design that implements reification, a process to derive concrete models from abstract ones by transformation, we design interactors that keep all design models alive at run-time. Interactors are based on finite state machines that can be inspected and manipulated at run-time and are synchronized over different devices and modalities using mappings. We show the expressiveness of state charts for modeling interactions, interaction resources, and interaction paradigms. We proof our approach by checking its conformance against common requirements for multimodal frameworks, classify it based on characteristics identified by others, and present initial results of a performance analysis.