Intelligent multimedia presentation systems: research and principles
Intelligent multimedia interfaces
A standard reference model for intelligent multimedia presentation systems
Computer Standards & Interfaces
Architecture and implementation of multimodal plug and play
Proceedings of the 5th international conference on Multimodal interfaces
Capturing user tests in a multimodal, multidevice informal prototyping tool
Proceedings of the 5th international conference on Multimodal interfaces
A graph-matching approach to dynamic media allocation in intelligent multimedia interfaces
Proceedings of the 10th international conference on Intelligent user interfaces
A platform for output dialogic strategies in natural multimodal dialogue systems
Proceedings of the 12th international conference on Intelligent user interfaces
A framework for the intelligent multimodal presentation of information
Signal Processing - Special section: Multimodal human-computer interfaces
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Dynamic user interface distribution for flexible multimodal interaction
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
| Hi-index | 0.00 |
In the context of natural multimodal dialogue systems, we address the challenging issue of the definition of cooperative answers in an appropriate multimodal form. Highlighting the intertwined relation of multimodal outputs with the content, we focus on the Dialogic strategy component, a component that defines from the set of possible contents to answer a user's request, the content to be presented to the user and its multimodal presentation. The content selection and the presentation allocation managed by the Dialogic strategy component are based on various constraints such as the availability of a modality and the user's preferences. Considering three generic types of dialogue strategies and their corresponding handled types of information as well as three generic types of presentation tasks, we present a first implementation of the Dialogic strategy component based on rules. By providing a graphical interface to configure the component by editing the rules, we show how the component can be easily modified by ergonomists at design time for exploring different solutions. In further work we envision letting the user modify the component at runtime.