Generating explanatory captions for information graphics

  • Authors:
  • Vibhu O. Mittal;Steven Roth;Johanna D. Moore;Joe Mattis;Giuseppe Carenini

  • Affiliations:
  • Learning Research & Dev. Center and Department of Computer Science, University of Pittsburgh, Pittsburgh, PA and Robotics Institute, School of Computer Science, Carnegie-Mellon University, Pittsbu ...;Learning Research & Dev. Center and Department of Computer Science, University of Pittsburgh, Pittsburgh, PA and Robotics Institute, School of Computer Science, Carnegie-Mellon University, Pittsbu ...;Learning Research & Dev. Center and Department of Computer Science, University of Pittsburgh, Pittsburgh, PA and Robotics Institute, School of Computer Science, Carnegie-Mellon University, Pittsbu ...;Learning Research & Dev. Center and Department of Computer Science, University of Pittsburgh, Pittsburgh, PA and Robotics Institute, School of Computer Science, Carnegie-Mellon University, Pittsbu ...;Learning Research & Dev. Center and Department of Computer Science, University of Pittsburgh, Pittsburgh, PA and Robotics Institute, School of Computer Science, Carnegie-Mellon University, Pittsbu ...

  • Venue:
  • IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
  • Year:
  • 1995

Quantified Score

Hi-index 0.01

Visualization

Abstract

Graphical presentations can he used to communicate information in relational data sets suffciently and effectively However novel graphical presentations about numerous attributes and their relationships are often difficult to understand completely until explained Automatically generated graphical presenlations must therefore either be limited to simple conventional ones or risk incornprehensibility One way of alleviating this problem is to design graphical presentation systems that can work in conjunction with a natural language generator to produce explanatory captions This paper presents three strategies for generating explanatory captions to accompany information graphics based on (1) a representation of the structure of the graphical presentation (2) a framework for identifying the perceptual complexity of graphical elements and (3) the structure of the data expressed in the graphic We describe an implemented system and illustrate how it is used to generate explanatory captions for a range of graphics from a data set about real estate transactions in Pittsburgh.