Context-aware design of adaptable multimodal documents
Multimedia Tools and Applications
Modality effects on cognitive load and performance in high-load information presentation
Proceedings of the 14th international conference on Intelligent user interfaces
| Hi-index | 0.00 |
This paper advances a formal approach about how to encode cognitive relevance into the design of interfaces of multimodal systems, with a focus on the automatic multimedia generation systems. We make a proposal that the optimality of the encoding of cognitive relevance depends on a proper formalization of the processes of modality allocation and modality combination. We describe how this can be done by adopting and encoding the Principle of Relevance based modality combination which evolved out of our formal analysis of modality allocations and modality combinations.