Text generation: using discourse strategies and focus constraints to generate natural language text
Text generation: using discourse strategies and focus constraints to generate natural language text
Automating the design of graphical presentations of relational information
ACM Transactions on Graphics (TOG)
The visual display of quantitative information
The visual display of quantitative information
Data characterization for intelligent graphics presentation
CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Task-analytic approach to the automated design of graphic presentations
ACM Transactions on Graphics (TOG)
Automating the design of network diagrams
Automating the design of network diagrams
Plan-based integration of natural language and graphics generation
Artificial Intelligence - Special volume on natural language processing
Intelligent multimedia presentation systems: research and principles
Intelligent multimedia interfaces
Interactive graphic design using automatic presentation knowledge
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using argumentation to control lexical choice: a functional unification implementation
Using argumentation to control lexical choice: a functional unification implementation
Multimedia and comprehension: the relationship among text, animation, and captions
Journal of the American Society for Information Science
Centering: a framework for modeling the local coherence of discourse
Computational Linguistics
Integrating planning and task-based design for multimedia presentation
Proceedings of the 2nd international conference on Intelligent user interfaces
Handbook of Natural Language Processing
Handbook of Natural Language Processing
Planning English Sentences
Controlling Content Realization with Functional Unification Grammars
Proceedings of the 6th International Workshop on Natural Language Generation: Aspects of Automated Natural Language Generation
Japanese discourse and the process of centering
Computational Linguistics
Automatic generation of multimodal weather reports from datasets
ANLC '92 Proceedings of the third conference on Applied natural language processing
Using focus to generate complex and simple sentences
ACL '84 Proceedings of the 10th International Conference on Computational Linguistics and 22nd annual meeting on Association for Computational Linguistics
Conciseness through aggregation in text generation
ACL '95 Proceedings of the 33rd annual meeting on Association for Computational Linguistics
The computational complexity of avoiding conversational implicatures
ACL '90 Proceedings of the 28th annual meeting on Association for Computational Linguistics
Referring to world objects with text and pictures
COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 1
Artificial Intelligence
Generating referring expressions: boolean extensions of the incremental algorithm
Computational Linguistics
An Empirical Study of Multimedia Argumentation
ICCS '01 Proceedings of the International Conference on Computational Sciences-Part I
IMPROVISE: Automated Generation of Animated Graphics for Coordinated Multimedia Presentations
CMC '98 Revised Papers from the Second International Conference on Cooperative Multimodal Communication
Computational Linguistics
Pipelines and size constraints
Computational Linguistics
Towards constructive text, diagram, and layout generation for information presentation
Computational Linguistics
High-level authoring of illustrated documents
Natural Language Engineering
A representation for complex and evolving data dependencies in generation
ANLC '00 Proceedings of the sixth conference on Applied natural language processing
User-system dialogues and the notion of focus
The Knowledge Engineering Review
International Journal of Human-Computer Studies
A Reference Architecture for Generation Systems
Natural Language Engineering
From RAGS to RICHES: exploiting the potential of a flexible generation architecture
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Optimizing Referential Coherence in Text Generation
Computational Linguistics
A two-stage model for content determination
EWNLG '01 Proceedings of the 8th European workshop on Natural Language Generation - Volume 8
An experiment to evaluate the effectiveness of cross-media cues in computer media
SIGDIAL '02 Proceedings of the 3rd SIGdial workshop on Discourse and dialogue - Volume 2
Reinterpretation of an existing NLG system in a generic generation architecture
INLG '00 Proceedings of the first international conference on Natural language generation - Volume 14
An integrated framework for text planning and pronominalisation
INLG '00 Proceedings of the first international conference on Natural language generation - Volume 14
A Reference Architecture for Natural Language Generation Systems
Natural Language Engineering
(Natural language) interaction with graphical representations of statistical data
W4A '07 Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A)
Improving accessibility to statistical graphs: the iGraph-Lite system
Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
A syntactic analysis of accessibility to a corpus of statistical graphs
W4A '08 Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A)
Multi-modal presentation of medical histories
Proceedings of the 13th international conference on Intelligent user interfaces
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
ACM Transactions on Accessible Computing (TACCESS)
How many words is a picture worth? Automatic caption generation for news images
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
The automated understanding of simple bar charts
Artificial Intelligence
ICCHP'06 Proceedings of the 10th international conference on Computers Helping People with Special Needs
Automatically recognizing intended messages in grouped bar charts
Diagrams'12 Proceedings of the 7th international conference on Diagrammatic Representation and Inference
UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: design methods, tools, and interaction techniques for eInclusion - Volume Part I
Evaluating a Tool for Improving Accessibility to Charts and Graphs
ACM Transactions on Computer-Human Interaction (TOCHI)
Augmenting visualization with natural language translation of interaction: a usability study
EuroVis '13 Proceedings of the 15th Eurographics Conference on Visualization
Hi-index | 0.00 |
Graphical presentations can be used to communicate information in relational data sets succinctly and effectively. However, novel graphical presentations that represent many attributes and relationships are often difficult to understand completely until explained. Automatically generated graphical presentations must therefore either be limited to generating simple, conventionalized graphical presentations, or risk incomprehensibility. A possible solution to this problem would be to extend automatic graphical presentation systems to generate explanatory captions in natural language, to enable users to understand the information expressed in the graphic. This paper presents a system to do so. It uses a text planner to determine the content and structure of the captions based on: (1) a representation of the structure of the graphical presentation and its mapping to the data it depicts, (2) a framework for identifying the perceptual complexity of graphical elements, and (3) the structure of the data expressed in the graphic. The output of the planner is further processed regarding issues such as ordering, aggregation, centering, generating referring expressions, and lexical choice. We discuss the architecture of our system and its strengths and limitations. Our implementation is currently limited to 2-D charts and maps, but, except for lexical information, it is completely domain independent. We illustrate our discussion with figures and generated captions about housing sales in Pittsburgh.