A design space for multimodal systems: concurrent processing and data fusion
INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
Tangible bits: towards seamless interfaces between people, bits and atoms
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Phidgets: easy development of physical interfaces through physical widgets
Proceedings of the 14th annual ACM symposium on User interface software and technology
iStuff: a physical user interface toolkit for ubiquitous computing environments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A framework for rapid development of multimodal interfaces
Proceedings of the 5th international conference on Multimodal interfaces
Rapidly prototyping Single Display Groupware through the SDGToolkit
AUIC '04 Proceedings of the fifth conference on Australasian user interface - Volume 28
ICARE software components for rapidly developing multimodal interfaces
Proceedings of the 6th international conference on Multimodal interfaces
reacTIVision: a computer-vision framework for table-based tangible interaction
Proceedings of the 1st international conference on Tangible and embedded interaction
User interface description languages for next generation user interfaces
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Sphinx-4: a flexible open source framework for speech recognition
Sphinx-4: a flexible open source framework for speech recognition
Designing context-aware multimodal virtual environments
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Démonstration: HephaisTK, une boîte à outils pour le prototypage d'interfaces multimodales
Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Human Machine Interaction
MEMODULES as Tangible Shortcuts to Multimedia Information
Human Machine Interaction
ACM Transactions on Computer-Human Interaction (TOCHI)
OpenWizard: une approche pour la création et l'évaluation rapide de prototypes multimodaux
Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
Fusion engines for multimodal input: a survey
Proceedings of the 2009 international conference on Multimodal interfaces
Benchmarking fusion engines of multimodal interactive systems
Proceedings of the 2009 international conference on Multimodal interfaces
HephaisTK: a toolkit for rapid prototyping of multimodal interfaces
Proceedings of the 2009 international conference on Multimodal interfaces
An object-centric interaction framework for tangible interfaces in virtual environments
Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
i*Chameleon: a scalable and extensible framework for multimodal interaction
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Monte carlo methods for managing interactive state, action and feedback under uncertainty
Proceedings of the 24th annual ACM symposium on User interface software and technology
| Hi-index | 0.00 |
This paper reviews the challenges associated with the development of tangible and multimodal interfaces and exposes our experiences with the development of three different software architectures to rapidly prototype such interfaces. The article first reviews the state of the art, and further compares existing systems with our approaches. Finally, the article stresses the major issues associated with the development of toolkits allowing the creation of multimodal and tangible interfaces, and presents our future objectives.