Towards multimodal user interfaces composition based on UsiXML and MBD principles

Authors:
Sophie Lepreux;Anas Hariri;José Rouillard;Dimitri Tabary;Jean-Claude Tarby;Christophe Kolski
Affiliations:
Université de Valenciennes et du Hainaut-Cambrésis, LAMIH, UMR, Valenciennes Cedex 9, France;Université de Valenciennes et du Hainaut-Cambrésis, LAMIH, UMR, Valenciennes Cedex 9, France;Université de Lille 1, Laboratoire LIFL-Trigone, Villeneuve d'Ascq Cedex, France;Université de Valenciennes et du Hainaut-Cambrésis, LAMIH, UMR, Valenciennes Cedex 9, France;Université de Lille 1, Laboratoire LIFL-Trigone, Villeneuve d'Ascq Cedex, France;Université de Valenciennes et du Hainaut-Cambrésis, LAMIH, UMR, Valenciennes Cedex 9, France
Venue:
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Year:
2007

Citing 4
Cited 8

Design patterns: elements of reusable object-oriented software

Design patterns: elements of reusable object-oriented software
TAX: A Tree Algebra for XML

DBPL '01 Revised Papers from the 8th International Workshop on Database Programming Languages
Visual design of user interfaces by (de)composition

DSVIS'06 Proceedings of the 13th international conference on Interactive systems: Design, specification, and verification
A MDA-compliant environment for developing user interfaces of information systems

CAiSE'05 Proceedings of the 17th international conference on Advanced Information Systems Engineering

New Human-Computer Interactions Using Tangible Objects: Application on a Digital Tabletop with RFID Technology

Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction
Using semantic descriptions for adaptive mobile games UIs

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
De la composition de services à la composition d'interfaces homme-machine

Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
Application composition driven by UI composition

HCSE'10 Proceedings of the Third international conference on Human-centred software engineering
When the functional composition drives the user interfaces composition: process and formalization

Proceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems
Experiments in model driven composition of user interfaces

DAIS'10 Proceedings of the 10th IFIP WG 6.1 international conference on Distributed Applications and Interoperable Systems
Metamodeling functional and interactive parts of systems for composition considerations

Journal of Computational Methods in Sciences and Engineering
Towards conflict management in user interface composition driven by business needs

HCSE'12 Proceedings of the 4th international conference on Human-Centered Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

In software design, the reuse issue brings the increasing of web services, components and others techniques. These techniques allow reusing code associated to technical aspect (as software component). With the development of business components which can integrate technical aspect with HCI, the composition issue has appeared. Our previous work concerned the GUI composition based on an UIDL as UsiXML. With the generalization of Multimodal User Interfaces (MUI), MUI composition principles have to be studied. This paper aims at extend existing basic composition principles in order to treat multimodal interfaces. The same principle as in the previous work, based on the tree algebra, can be used in another level (AUI) of the UsiXML framework to support the Multimodal User Interfaces composing. This paper presents a case study on the food ordering system based on multimodal (coupling GUI and MUI). A conclusion and the future works in the HCI domain are presented.