A generic platform for addressing the multimodal challenge
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tangible bits: towards seamless interfaces between people, bits and atoms
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Ten myths of multimodal interaction
Communications of the ACM
Taming recognition errors with a multimodal interface
Communications of the ACM
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Georgia tech gesture toolkit: supporting experiments in gesture recognition
Proceedings of the 5th international conference on Multimodal interfaces
Architecture and implementation of multimodal plug and play
Proceedings of the 5th international conference on Multimodal interfaces
A framework for rapid development of multimodal interfaces
Proceedings of the 5th international conference on Multimodal interfaces
ICARE: a component-based approach for the design and development of multimodal interfaces
CHI '04 Extended Abstracts on Human Factors in Computing Systems
A conceptual framework for developing adaptive multimodal applications
Proceedings of the 11th international conference on Intelligent user interfaces
Validation et vérification formelles de systèmes interactifs multi-modaux fondées sur la preuve
IHM '06 Proceedings of the 18th International Conferenceof the Association Francophone d'Interaction Homme-Machine
Mixed reality: a model of mixed interaction
Proceedings of the working conference on Advanced visual interfaces
Authoring interfaces with combined use of graphics and voice for both stationary and mobile devices
Proceedings of the working conference on Advanced visual interfaces
Multimodal interaction on mobile phones: development and evaluation using ACICARE
Proceedings of the 8th conference on Human-computer interaction with mobile devices and services
A platform for output dialogic strategies in natural multimodal dialogue systems
Proceedings of the 12th international conference on Intelligent user interfaces
Proceedings of the 2nd international conference on Tangible and embedded interaction
Authoring pervasive multimodal user interfaces
International Journal of Web Engineering and Technology
Towards Specifying Multimodal Collaborative User Interfaces: A Comparison of Collaboration Notations
Interactive Systems. Design, Specification, and Verification
Generating multimodal user interfaces for Web services
Interacting with Computers
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Formal Testing of Multimodal Interactive Systems
Engineering Interactive Systems
Conception de systèmes collaboratifs multimodaux: analyse comparative de notations
Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Human Machine Interaction
MEMODULES as Tangible Shortcuts to Multimedia Information
Human Machine Interaction
Designing multi-user multi-device systems: an architecture for multi-browsing applications
Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia
User evaluation of OIDE: a rapid prototyping platform for multimodal interaction
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
Fusion engines for multimodal input: a survey
Proceedings of the 2009 international conference on Multimodal interfaces
Benchmarking fusion engines of multimodal interactive systems
Proceedings of the 2009 international conference on Multimodal interfaces
Proceedings of the 2009 international conference on Multimodal interfaces
Proceedings of the 2009 international conference on Multimodal interfaces
HephaisTK: a toolkit for rapid prototyping of multimodal interfaces
Proceedings of the 2009 international conference on Multimodal interfaces
Platform for flexible integration of multimodal technologies into web application domain
E-ACTIVITIES'09/ISP'09 Proceedings of the 8th WSEAS International Conference on E-Activities and information security and privacy
Incorporating tilt-based interaction in multimodal user interfaces for mobile devices
TAMODIA'06 Proceedings of the 5th international conference on Task models and diagrams for users interface design
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
Improving multimodal interaction design with the MMWA authoring environment
Proceedings of the 28th ACM International Conference on Design of Communication
Dynamic user interface distribution for flexible multimodal interaction
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
An open distributed framework for adaptive user interaction in ambient intelligence
AmI'10 Proceedings of the First international joint conference on Ambient intelligence
Automatically testing interactive multimodal systems using task trees and fusion models
Proceedings of the 6th International Workshop on Automation of Software Test
OP: a novel programming model for integrated design and prototyping of mixed objects
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Using the user's point of view for interaction on mobile devices
23rd French Speaking Conference on Human-Computer Interaction
Service-oriented autonomic multimodal interaction in a pervasive environment
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Test of the ICARE platform fusion mechanism
DSVIS'05 Proceedings of the 12th international conference on Interactive Systems: design, specification, and verification
COST'10 Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and Enactment
Design of human-centric adaptive multimodal interfaces
International Journal of Human-Computer Studies
Autonomic management of multimodal interaction: DynaMo in action
Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems
A distributed staged architecture for multimodal applications
ECSA'07 Proceedings of the First European conference on Software Architecture
i*Chameleon: a platform for developing multimodal application with comprehensive development cycle
Proceedings of the 28th Annual ACM Symposium on Applied Computing
| Hi-index | 0.00 |
Although several real multimodal systems have been built, their development still remains a difficult task. In this paper we address this problem of development of multimodal interfaces by describing a component-based approach, called ICARE, for rapidly developing multimodal interfaces. ICARE stands for Interaction-CARE (Complementarity Assignment Redundancy Equivalence). Our component-based approach relies on two types of software components. Firstly ICARE elementary components include Device components and Interaction Language components that enable us to develop pure modalities. The second type of components, called Composition components, define combined usages of modalities. Reusing and assembling ICARE components enable rapid development of multimodal interfaces. We have developed several multimodal systems using ICARE and we illustrate the discussion using one of them: the FACET simulator of the Rafale French military plane cockpit.