A compositional model of human-computer dialogues
Multimedia interface design
Intelligent multimedia presentation systems: research and principles
Intelligent multimedia interfaces
Planning multimedia explanations using communicative acts
Intelligent multimedia interfaces
On the knowledge underlying multimedia presentations
Intelligent multimedia interfaces
Designing presentation in multimedia interfaces
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Generating coherent presentations employing textual and visual material
Artificial Intelligence Review - Special issue on integration of natural language and vision processing: intelligent multimedia
Grammar-based articulation for multimedia document design
Multimedia Systems
Integrating planning and task-based design for multimedia presentation
Proceedings of the 2nd international conference on Intelligent user interfaces
A Graduated Assignment Algorithm for Graph Matching
IEEE Transactions on Pattern Analysis and Machine Intelligence
Designing effective multimedia presentations
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Device-dependant modality selection for user-interfaces: an empirical study
Proceedings of the 7th international conference on Intelligent user interfaces
Context-Based Multimodal Input Understanding in Conversational Systems
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Proceedings of the 17th annual ACM symposium on User interface software and technology
Automated generation of graphic sketches by example
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Preference elicitation for interface optimization
Proceedings of the 18th annual ACM symposium on User interface software and technology
Enabling context-sensitive information seeking
Proceedings of the 11th international conference on Intelligent user interfaces
The delivery of multimedia presentations in a graphical user interface environment
Proceedings of the 11th international conference on Intelligent user interfaces
A platform for output dialogic strategies in natural multimodal dialogue systems
Proceedings of the 12th international conference on Intelligent user interfaces
Natural multimodal dialogue systems: a configurable dialogue and presentation strategies component
Proceedings of the 9th international conference on Multimodal interfaces
Responsive information architect: enabling context-sensitive information seeking
AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Adaptive content presentation for the web
The adaptive web
Decision theoretic perspective on optimizing intelligent help
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Automatically generating personalized user interfaces with Supple
Artificial Intelligence
Understanding, Manipulating and Searching Hand-Drawn Concept Maps
ACM Transactions on Intelligent Systems and Technology (TIST)
Expert Systems with Applications: An International Journal
| Hi-index | 0.00 |
To aid users in exploring large and complex data sets, we are building an intelligent multimedia conversation system. Given a user request, our system dynamically creates a multimedia response that is tailored to the interaction context. In this paper, we focus on the problem of media allocation, a process that assigns one or more media, such as graphics or speech, to best convey the intended response content. Specifically, we develop a graph-matching approach to media allocation, whose goal is to find a set of data-media mappings that maximizes the satisfaction of various allocation constraints (e.g., data-media compatibility and presentation consistency constraints). Compared to existing rule-based or plan-based approaches to media allocation, our work offers three unique contributions. First, we provide an extensible computational framework that optimizes media assignments by dynamically balancing all relevant constraints. Second, we use feature-based metrics to uniformly model various allocation constraints, including those cross-content and cross-media constraints, which often require special treatment in existing approaches. Third, we further improve the quality of a response by automatically detecting and repairing undesired allocation results. We have applied our approach to two different applications and our preliminary study has shown the promise of our work.