Software architecture: perspectives on an emerging discipline
Software architecture: perspectives on an emerging discipline
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Towards a taxonomy of software connectors
Proceedings of the 22nd international conference on Software engineering
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System
IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
Capturing user tests in a multimodal, multidevice informal prototyping tool
Proceedings of the 5th international conference on Multimodal interfaces
ICARE: a component-based approach for the design and development of multimodal interfaces
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Informal prototyping of continuous graphical interactions by demonstration
Proceedings of the 18th annual ACM symposium on User interface software and technology
Reflective physical prototyping through integrated design, test, and analysis
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CHI '07 Extended Abstracts on Human Factors in Computing Systems
Eyepatch: prototyping camera-based interaction through examples
Proceedings of the 20th annual ACM symposium on User interface software and technology
High Level Data Fusion on a Multimodal Interactive Applications Platform
ISM '08 Proceedings of the 2008 Tenth IEEE International Symposium on Multimedia
EyesWeb - Toward Gesture and Affect Recognition in Dance/Music Interactive Systems
ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
A fusion framework for multimodal interactive applications
Proceedings of the 2009 international conference on Multimodal interfaces
Benchmarking fusion engines of multimodal interactive systems
Proceedings of the 2009 international conference on Multimodal interfaces
HephaisTK: a toolkit for rapid prototyping of multimodal interfaces
Proceedings of the 2009 international conference on Multimodal interfaces
Letras: an architecture and framework for ubiquitous pen-and-paper interaction
Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
Seamless integration of heterogeneous UI components
Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
An interactive dialogue modelling editor for designing multimodal applications
Proceedings of the 28th ACM International Conference on Design of Communication
Deriving vocal interfaces from logical descriptions in multi-device authoring environments
ICWE'10 Proceedings of the 10th international conference on Web engineering
Component-based high fidelity interactive prototyping of post-WIMP interactions
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Model-based design and implementation of interactive spaces for information interaction
HCSE'10 Proceedings of the Third international conference on Human-centred software engineering
Supporting multimodality in service-oriented model-based development environments
HCSE'10 Proceedings of the Third international conference on Human-centred software engineering
Building multimodal interfaces out of executable, model-based interactors and mappings
HCII'11 Proceedings of the 14th international conference on Human-computer interaction: design and development approaches - Volume Part I
UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: design for all and eInclusion - Volume Part I
A framework to develop VR interaction techniques based on openinterface and AFreeCA
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
An adaptive solution for intra-operative gesture-based human-machine interaction
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Model-based design and generation of a gesture-based user interface navigation control
Proceedings of the 10th Brazilian Symposium on on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction
Engineering device-spanning, multimodal web applications using a model-based design approach
Proceedings of the 18th Brazilian symposium on Multimedia and the web
UCAmI'12 Proceedings of the 6th international conference on Ubiquitous Computing and Ambient Intelligence
Special Section on Touching the 3rd Dimension: Prototyping 3D haptic data visualizations
Computers and Graphics
Toward rapid and iterative development of tangible, collaborative, distributed user interfaces
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
UISKEI++: multi-device wizard of oz prototyping
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
The CoGenIVE concept revisited: a toolkit for prototyping multimodal systems
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
i*Chameleon: a platform for developing multimodal application with comprehensive development cycle
Proceedings of the 28th Annual ACM Symposium on Applied Computing
EMIL: a rapid prototyping authoring environment for the design of interactive surface applications
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I
Hi-index | 0.00 |
In this paper we present an extensible software workbench for supporting the effective and dynamic prototyping of multimodal interactive systems. We hypothesize the construction of such applications to be based on the assembly of several components, namely various and sometimes interchangeable modalities at the input, fusion-fission components, and also several modalities at the output. Successful realization of advanced interactions can benefit from early prototyping and the iterative implementation of design requires the easy integration, combination, replacement, or upgrade of components. We have designed and implemented a thin integration platform able to manage these key elements, and thus provide the research community a tool to bridge the gap of the current support for multimodal applications implementation. The platform is included within a workbench offering visual editors, non-intrusive tools, components and techniques to assemble various modalities provided in different implementation technologies, while keeping a high level of performance of the integrated system.