Attention, intentions, and the structure of discourse
Computational Linguistics
Probabilistic reasoning in intelligent systems: networks of plausible inference
Probabilistic reasoning in intelligent systems: networks of plausible inference
Plan-based integration of natural language and graphics generation
Artificial Intelligence - Special volume on natural language processing
A Bayesian model of plan recognition
Artificial Intelligence
Recognizing complex discourse acts: a tripartite plan-based model of dialogue
Recognizing complex discourse acts: a tripartite plan-based model of dialogue
A computational architecture for conversation
UM '99 Proceedings of the seventh international conference on User modeling
Mapping communicative goals into conceptual tasks to generate graphics in discourse
Proceedings of the 5th international conference on Intelligent user interfaces
Plan Recognition in Natural Language Dialogue
Plan Recognition in Natural Language Dialogue
Intentions in the coordinated generation of graphics and text from tabular data
Knowledge and Information Systems
The Psychology of Human-Computer Interaction
The Psychology of Human-Computer Interaction
Bayesian Models for Keyhole Plan Recognition in an Adventure Game
User Modeling and User-Adapted Interaction
Building Probabilistic Networks: 'Where Do the Numbers Come From?' Guest Editors' Introduction
IEEE Transactions on Knowledge and Data Engineering
Probabilistic Plan Recognition for Hostile Agents
Proceedings of the Fourteenth International Florida Artificial Intelligence Research Society Conference
Probabilistic State-Dependent Grammars for Plan Recognition
UAI '00 Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence
Efficient analysis of complex diagrams using constraint-based parsing
ICDAR '95 Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 2) - Volume 2
A plan-based approach to speech act recognition
A plan-based approach to speech act recognition
Towards constructive text, diagram, and layout generation for information presentation
Computational Linguistics
Describing complex charts in natural language: a caption generation system
Computational Linguistics - Special issue on natural language generation
High-level authoring of illustrated documents
Natural Language Engineering
A model of plan inference that distinguishes between the beliefs of actors and observers
ACL '86 Proceedings of the 24th annual meeting on Association for Computational Linguistics
International Journal of Human-Computer Studies
Attack Plan Recognition and Prediction Using Causal Networks
ACSAC '04 Proceedings of the 20th Annual Computer Security Applications Conference
Probabilistic grounding of situated speech using plan recognition and reference resolution
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
How to Lie With Statistics
A Model of Perceptual Task Effort for Bar Charts and its Role in Recognizing Intention
User Modeling and User-Adapted Interaction
MATCHKiosk: a multimodal interactive city guide
ACLdemo '04 Proceedings of the ACL 2004 on Interactive poster and demonstration sessions
ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Choosing the content of textual summaries of large time-series data sets
Natural Language Engineering
MeteoBayes: Effective Plan Recognition in a Weather Dialogue System
IEEE Intelligent Systems
The Mobile Sensing Platform: An Embedded Activity Recognition System
IEEE Pervasive Computing
Exploiting Evidence Analysis in Plan Recognition
UM '07 Proceedings of the 11th international conference on User Modeling
A cognitive model for understanding graphical perception
Human-Computer Interaction
A probabilistic plan recognition algorithm based on plan tree grammars
Artificial Intelligence
Monitoring teams by overhearing: a multi-agent plan-recognition approach
Journal of Artificial Intelligence Research
AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence
Generating artificial corpora for plan recognition
UM'05 Proceedings of the 10th international conference on User Modeling
Getting computers to see information graphics so users do not have to
ISMIS'05 Proceedings of the 15th international conference on Foundations of Intelligent Systems
Toward a comprehensive model of graph comprehension: making the case for spatial cognition
Diagrams'06 Proceedings of the 4th international conference on Diagrammatic Representation and Inference
Abstractive summarization of line graphs from popular media
WASDGML '11 Proceedings of the Workshop on Automatic Summarization for Different Genres, Media, and Languages
Improving the accessibility of line graphs in multimodal documents
SLPAT '11 Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies
Wikimantic: disambiguation for short queries
NLDB'12 Proceedings of the 17th international conference on Applications of Natural Language Processing and Information Systems
Proceedings of the 2013 international conference on Intelligent user interfaces
Towards retrieving relevant information graphics
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Hi-index | 0.00 |
While identifying the intention of an utterance has played a major role in natural language understanding, this work is the first to extend intention recognition to the domain of information graphics. A tenet of this work is the belief that information graphics are a form of language. This is supported by the observation that the overwhelming majority of information graphics from popular media sources appear to have some underlying goal or intended message. As Clark noted, language is more than just words. It is any ''signal'' (or lack of signal when one is expected), where a signal is a deliberate action that is intended to convey a message (Clark, 1996 [15]). As a form of language, information graphics contain communicative signals that can be used in a computational system to identify the message that the graphic conveys. We identify the communicative signals that appear in simple bar charts, and present an implemented Bayesian network methodology for reasoning about these signals and hypothesizing a bar chart's intended message. Once the message conveyed by an information graphic has been inferred, it can then be used to facilitate access to this information resource for a variety of users, including 1) users of digital libraries, 2) visually impaired users, and 3) users of devices where graphics are impractical or inaccessible.