Context-Sensitive Help for Multimodal Dialogue
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
XISL: a language for describing multimodal interaction scenarios
Proceedings of the 5th international conference on Multimodal interfaces
Interactive Multimodal User Interfaces for Mobile Devices
HICSS '04 Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 9 - Volume 9
A generic uiml vocabulary for device- and modality independent user interfaces
Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters
Addressing the mapping problem in user interface design with UsiXML
TAMODIA '04 Proceedings of the 3rd annual conference on Task models and diagrams
USIXML: a language supporting multi-path development of user interfaces
EHCI-DSVIS'04 Proceedings of the 2004 international conference on Engineering Human Computer Interaction and Interactive Systems
Solving the mapping problem in user interface design by seamless integration in IDEALXML
DSVIS'05 Proceedings of the 12th international conference on Interactive Systems: design, specification, and verification
Authoring interfaces with combined use of graphics and voice for both stationary and mobile devices
Proceedings of the working conference on Advanced visual interfaces
Authoring pervasive multimodal user interfaces
International Journal of Web Engineering and Technology
Colored graph transformation rules for model-driven engineering of multi-target systems
Proceedings of the third international workshop on Graph and model transformations
Cascading Dialog Modeling with UsiXML
Interactive Systems. Design, Specification, and Verification
Towards a minimalist multimodal dialogue framework using recursive MVC pattern
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Multimodal interfaces design issues: the fusion of well-designed voice and graphical user interfaces
Proceedings of the 26th annual ACM international conference on Design of communication
An extension of UML for the modeling of WIMP user interfaces
Journal of Visual Languages and Computing
Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems
Developing and evaluating web multimodal interfaces - a case study with usability principles
Proceedings of the 2009 ACM symposium on Applied Computing
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Human Machine Interaction
Semi-automatic multimodal user interface generation
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
Design of communication in multimodal web interfaces
Proceedings of the 27th ACM international conference on Design of communication
Incorporating tilt-based interaction in multimodal user interfaces for mobile devices
TAMODIA'06 Proceedings of the 5th international conference on Task models and diagrams for users interface design
Using automatic techniques to evaluate usability of web multimodal interfaces design
WebMedia '09 Proceedings of the XV Brazilian Symposium on Multimedia and the Web
Improving multimodal interaction design with the MMWA authoring environment
Proceedings of the 28th ACM International Conference on Design of Communication
Deriving vocal interfaces from logical descriptions in multi-device authoring environments
ICWE'10 Proceedings of the 10th international conference on Web engineering
Supporting multimodality in service-oriented model-based development environments
HCSE'10 Proceedings of the Third international conference on Human-centred software engineering
Building multimodal interfaces out of executable, model-based interactors and mappings
HCII'11 Proceedings of the 14th international conference on Human-computer interaction: design and development approaches - Volume Part I
Multimodal interactive systems to manage networked human work
OTM'06 Proceedings of the 2006 international conference on On the Move to Meaningful Internet Systems: AWeSOMe, CAMS, COMINF, IS, KSinBIT, MIOS-CIAO, MONET - Volume Part I
Model-based design and generation of a gesture-based user interface navigation control
Proceedings of the 10th Brazilian Symposium on on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction
| Hi-index | 0.00 |
A transformational approach for developing multimodal web user interfaces is presented that progressively moves from a task model and a domain model to a final user interface. This approach consists of three steps: deriving one or many abstract user interfaces from a task model and a domain model, deriving one or many concrete user interfaces from each abstract one, and producing the code of the corresponding final user interfaces. To ensure these steps, transformations are encoded as graph transformations performed on the involved models expressed in their graph equivalent. For each step, a graph grammar gathers relevant graph transformations for accomplishing the sub-steps. The final user interface is multimodal as it involves graphical (keyboard, mouse) and vocal interaction. The approach outlined in the paper is illustrated throughout a running example for a graphical interface, a vocal interface, and two multimodal interfaces with graphical and vocal predominances, respectively.