Verbal versus pictorial representations of objects in a human-computer interface
International Journal of Man-Machine Studies
Graphics and natural language as components of automatic explanation
Intelligent user interfaces
Planning English Sentences
A knowledge representation theory for natural language graphics
A knowledge representation theory for natural language graphics
A reactive approach to explanation in expert and advice-giving systems
A reactive approach to explanation in expert and advice-giving systems
TINLAP '75 Proceedings of the 1975 workshop on Theoretical issues in natural language processing
Planning coherent multisentential text
ACL '88 Proceedings of the 26th annual meeting on Association for Computational Linguistics
Natural language with integrated deictic and graphic gestures
HLT '89 Proceedings of the workshop on Speech and Natural Language
Apex: An Experiment in the Automated Creation of Pictorial Explanations
IEEE Computer Graphics and Applications
AutoBrief: a multimedia presentation system for assisting data analysis
Computer Standards & Interfaces
| Hi-index | 0.00 |
A number of researchers have investigated the use of planbased approaches to generate textual explanations (e.g., Appelt 1985; Hovy 1988; Moore 1989; Maybury 1990b). This paper extends this approach to generate multimedia explanations by defining three types of communicative acts: linguistic acts (illocutionary and locutionary speech acts), visual acts (e.g., deictic acts), and media-independent rhetorical acts (e.g., identify, describe). This paper formalizes several of these communicative acts as operators in the library of a hierarchical planner. A computational implementation is described which uses these plan operators to compose route plans in coordinated natural language and graphics in the context of a cartographic information system.