An approach integrating two complementary model-based environments for the construction of multimodal interactive applications

Authors:
David Navarre;Philippe Palanque;Pierre Dragicevic;Rémi Bastide
Affiliations:
LIIHS-IRIT, Université Paul Sabatier, 118, Route de Narbonne, F-31062 Toulouse Cedex, France;LIIHS-IRIT, Université Paul Sabatier, 118, Route de Narbonne, F-31062 Toulouse Cedex, France;LIIHS-IRIT, Université Paul Sabatier, 118, Route de Narbonne, F-31062 Toulouse Cedex, France;LIIHS-IRIT, Université Paul Sabatier, 118, Route de Narbonne, F-31062 Toulouse Cedex, France
Venue:
Interacting with Computers
Year:
2006

Citing 12
Cited 4

A specification language for direct-manipulation user interfaces

ACM Transactions on Graphics (TOG) - Special issue on user interface software
Extending Petri nets for specifying man-machine dialogues

International Journal of Man-Machine Studies
Encapsulating knowledge for intelligent automatic interaction objects selection

INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
Specification of interface interaction objects

CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Post-WIMP user interfaces

Communications of the ACM
Hybrid high-level nets

WSC '96 Proceedings of the 28th conference on Winter simulation
Software architecture in practice

Software architecture in practice
Interaction and modeling techniques for desktop two-handed input

Proceedings of the 11th annual ACM symposium on User interface software and technology
A software model and specification language for non-WIMP user interfaces

ACM Transactions on Computer-Human Interaction (TOCHI)
Exploring terra incognita in the design space of query devices

Proceedings of the IFIP TC2/WG2.7 Working Conference on Engineering for Human-Computer Interaction
Petri net objects for the design, validation and prototyping of user-driven interfaces

INTERACT '90 Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction
On the use of transition diagrams in the design of a user interface for an interactive computer system

ACM '69 Proceedings of the 1969 24th national conference

The Guilet Dialog Model and Dialog Core for Graphical User Interfaces

HCSE-TAMODIA '08 Proceedings of the 2nd Conference on Human-Centered Software Engineering and 7th International Workshop on Task Models and Diagrams
High-Fidelity Prototyping of Interactive Systems Can Be Formal Too

Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends
FlowStates: prototypage d'applications interactives avec des flots de données et des machines à états

Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
Usability study of multi-modal interfaces using eye-tracking

INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a tool suite for the engineering of multimodal Post-WIMP Interactive Systems. The work presented here extends previous work done on design, prototyping, specification and verification of interactive systems and integrates two previously unrelated approaches. The first element of this integration is ICoM (a data-flow model dedicated to low-level input modelling) and its environment ICon which allows for editing and simulating ICoM models. The other element is ICOs (a formal description technique mainly dedicated to dialogue modelling) and its environment PetShop, which allows for editing, simulating and verifying ICOs models. This paper shows how these two approaches have been integrated and that this integration allows for engineering multimodal interactive systems. We show on a Range Slider case study how these tools can be used for prototyping interactive systems in general and multimodal interaction techniques in particular. We also present in details how the changes in the interaction techniques impact the models at various levels of the software architecture.