Improving automatic image captioning using text summarization techniques

  • Authors:
  • Laura Plaza;Elena Lloret;Ahmet Aker

  • Affiliations:
  • Universidad Complutense de Madrid, Madrid, Spain;University of Alicante, Alicante, Spain;University of Sheffield, Sheffield, UK

  • Venue:
  • TSD'10 Proceedings of the 13th international conference on Text, speech and dialogue
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents two different approaches to automatic captioning of geo-tagged images by summarizing multiple web-documents that contain information related to an image's location: a graph-based and a statistical-based approach. The graph-based method uses text cohesion techniques to identify information relevant to a location. The statistical-based technique relies on different word or noun phrases frequency counting for identifying pieces of information relevant to a location. Our results show that summaries generated using these two approaches lead indeed to higher ROUGE scores than n-gram language models reported in previous work.