Reasoning and revision in hybrid representation systems
Reasoning and revision in hybrid representation systems
Issues in the automated generation of animated presentations
Proceedings on Graphics interface '90
Interactive multimedia explanation for equipment maintenance and repair
HLT '90 Proceedings of the workshop on Speech and Natural Language
Graphics and natural language as components of automatic explanation
Intelligent user interfaces
Sprache und Raum: Natürlichsprachlicher Zugang zu visuellen Daten
Repräsentation und Verarbeitung räumlichen Wissens
Wissensbasierte Perspektivenwahl für die automatische Erzeugung von 3D-Objektdarstellungen
Graphik und KI, GI-Fachgespräch
Planning text for advisory dialogues
ACL '89 Proceedings of the 27th annual meeting on Association for Computational Linguistics
Constraining Tree Adjoining Grammars by unification
COLING '90 Proceedings of the 13th conference on Computational linguistics - Volume 2
Coordinating text and graphics in explanation generation
HLT '89 Proceedings of the workshop on Speech and Natural Language
Embodiment in conversational interfaces: Rea
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Planning text for advisory dialogues: capturing intentional and rhetorical information
Computational Linguistics
Automatic generation of multimodal weather reports from datasets
ANLC '92 Proceedings of the third conference on Applied natural language processing
Generating spatial descriptions for cross-modal references
ANLC '92 Proceedings of the third conference on Applied natural language processing
Integrating natural language components into graphical discourse
ANLC '92 Proceedings of the third conference on Applied natural language processing
ACL '93 Proceedings of the 31st annual meeting on Association for Computational Linguistics
Referring to world objects with text and pictures
COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 1
Coordination and context-dependence in the generation of embodied conversation
INLG '00 Proceedings of the first international conference on Natural language generation - Volume 14
A presentation model for multimedia summaries of behavior
Proceedings of the 13th international conference on Intelligent user interfaces
Concept keyboards in the animation of standard algorithms
Journal of Visual Languages and Computing
Multimodal references in GEORAL Tactile
ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment
Natural language and exploration of an information space: the ALFresco interactive system
IJCAI'91 Proceedings of the 12th international joint conference on Artificial intelligence - Volume 2
Generating adaptive presentations of hydrologic behavior
IDEAL'06 Proceedings of the 7th international conference on Intelligent Data Engineering and Automated Learning
| Hi-index | 0.00 |
Multimodal interfaces combining, e.g., natural language and graphics take advantage of both the individual strength of each communication mode and the fact that several modes can be employed in parallel, e.g., in the text-picture combinations of illustrated documents. It is an important goal of this research not simply to merge the verbalization results of a natural language generator and the visualization results of a knowledge-based graphics generator, but to carefully coordinate graphics and text in such a way that they complement each other. We describe the architecture of the knowledge-based presentation system WIP which guarantees a design process with a large degree of freedom that can be used to tailor the presentation to suit the specific context. In WIP, decisions of the language generator may influence graphics generation and graphical constraints may sometimes force decisions in the language production process. In this paper, we focus on the influence of graphical constraints on text generation. In particular, we describe the generation of cross-modal references, the revision of text due to graphical constraints and the clarification of graphics through text.