Using explicit discourse rules to guide video enrichment

  • Authors:
  • Michiel Hildebrand;Lynda Hardman

  • Affiliations:
  • Centrum voor Wiskunde en Informatica, Amsterdam, Netherlands;Centrum voor Wiskunde en Informatica, Amsterdam, Netherlands

  • Venue:
  • Proceedings of the 22nd international conference on World Wide Web companion
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Video content analysis and named entity extraction are increasingly used to automatically generate content annotations for TV programs. A potential use of these annotations is to provide an entry point to background information that users can consume on a second screen. Automatic enrichments are, however, meaningless when it is unclear to the user what they can do with them and why they would. We propose to contextualize the annotations by an explicit representation of discourse in the form of scene templates. Through content rules these templates are populated with the relevant annotations. We illustrate this idea with an example video and annotations generated in the LinkedTV1 project.