Intelligent multimedia presentation systems: research and principles
Intelligent multimedia interfaces
A generic platform for addressing the multimodal challenge
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A standard reference model for intelligent multimedia presentation systems
Computer Standards & Interfaces
An architecture for more realistic conversational systems
Proceedings of the 6th international conference on Intelligent user interfaces
Designing interaction, not interfaces
Proceedings of the working conference on Advanced visual interfaces
ICARE software components for rapidly developing multimodal interfaces
Proceedings of the 6th international conference on Multimodal interfaces
Proceedings of the 17th annual ACM symposium on User interface software and technology
A graph-matching approach to dynamic media allocation in intelligent multimedia interfaces
Proceedings of the 10th international conference on Intelligent user interfaces
A framework for the intelligent multimodal presentation of information
Signal Processing - Special section: Multimodal human-computer interfaces
A framework for the combination and characterization of output modalities
DSV-IS'00 Proceedings of the 7th international conference on Design, specification, and verification of interactive systems
Natural multimodal dialogue systems: a configurable dialogue and presentation strategies component
Proceedings of the 9th international conference on Multimodal interfaces
IHM '07 Proceedings of the 19th International Conference of the Association Francophone d'Interaction Homme-Machine
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Adaptive probabilistic fission for multimodal systems
Proceedings of the 24th Australian Computer-Human Interaction Conference
| Hi-index | 0.00 |
The development of natural multimodal dialogue systems remains a very difficult task. The flexibility and naturalness they offer result in an increased complexity that current software tools do not address appropriately. One challenging issue we address here is the generation of cooperative responses in an appropriate multimodal form, highlighting the intertwined relation of content and presentation. We identify a key component, the dialogic strategy component, as a mediator between the natural dialogue management and the multimodal presentation. This component selects the semantic information content to be presented according to various presentation constraints. Constraints include inherent characteristics of modalities, the availability of a modality as well as preferences of the user. Thus the cooperative behaviour of the system could be adapted as could its multimodal behaviour. In this paper, we present the dialogic strategy component and an associated platform to quickly develop output multimodal cooperative responses in order to explore different dialogic strategies.