Exploring and exploiting the limited utility of captions in recognizing intention in information graphics

Authors:
Stephanie Elzer;Sandra Carberry;Daniel Chester;Seniz Demir;Nancy Green;Ingrid Zukerman;Keith Trnka
Affiliations:
Millersville University, Millersville, PA;University of Delaware, Newark, DE;University of Delaware, Newark, DE;University of Delaware, Newark, DE;Univ. of NC at Greensboro, Greensboro, NC;Monash Univ., Clayton, Victoria Australia;University of Delaware, Newark, DE
Venue:
ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Year:
2005

Citing 5
Cited 12

The automated mapping of plans for plan recognition

AAAI'94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 2)
Mapping communicative goals into conceptual tasks to generate graphics in discourse

Proceedings of the 5th international conference on Intelligent user interfaces
Efficient analysis of complex diagrams using constraint-based parsing

ICDAR '95 Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 2) - Volume 2
Autobrief: an experimental system for the automatic generation of briefings in integrated text and information graphics

International Journal of Human-Computer Studies
A probabilistic framework for recognizing intention in information graphics

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence

Information graphics: an untapped resource for digital libraries

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
A probabilistic framework for recognizing intention in information graphics

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Accessible bar charts for visually impaired users

Telehealth/AT '08 Proceedings of the IASTED International Conference on Telehealth/Assistive Technologies
Recognizing the intended message of line graphs

Diagrams'10 Proceedings of the 6th international conference on Diagrammatic representation and inference
Interactive SIGHT: textual access to simple bar charts

The New Review of Hypermedia and Multimedia - Web Accessibility
The automated understanding of simple bar charts

Artificial Intelligence
Abstractive summarization of line graphs from popular media

WASDGML '11 Proceedings of the Workshop on Automatic Summarization for Different Genres, Media, and Languages
Summarizing figures, tables, and algorithms in scientific publications to augment search results

ACM Transactions on Information Systems (TOIS)
Communicative signals as the key to automated understanding of simple bar charts

Diagrams'06 Proceedings of the 4th international conference on Diagrammatic Representation and Inference
Automatically recognizing intended messages in grouped bar charts

Diagrams'12 Proceedings of the 7th international conference on Diagrammatic Representation and Inference
Access to multimodal articles for individuals with sight impairments

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on highlights of the decade in interactive intelligent systems
What is being measured in an information graphic?

CICLing'13 Proceedings of the 14th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a corpus study that explores the extent to which captions contribute to recognizing the intended message of an information graphic. It then presents an implemented graphic interpretation system that takes into account a variety of communicative signals, and an evaluation study showing that evidence obtained from shallow processing of the graphic's caption has a significant impact on the system's success. This work is part of a larger project whose goal is to provide sight-impaired users with effective access to information graphics.