Generating story variants with constrained video recombination

  • Authors:
  • Alberto Piacenza;Fabrizio Guerrini;Nicola Adami;Riccardo Leonardi;Julie Porteous;Jonathan Teutenberg;Marc Cavazza

  • Affiliations:
  • University of Brescia, Brescia, Italy;University of Brescia, Brescia, Italy;University of Brescia, Brescia, Italy;University of Brescia, Brescia, Italy;Teesside University, Middlesbrough, United Kingdom;Teesside University, Middlesbrough, United Kingdom;Teesside University, Middlesbrough, United Kingdom

  • Venue:
  • MM '11 Proceedings of the 19th ACM international conference on Multimedia
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel approach to the automatic generation of filmic variants within an implemented Video-Based Storytelling (VBS) system that successfully integrates video segmentation with stochastically controlled re-ordering techniques and narrative generation via AI planning. We have introduced flexibility into the video recombination process by sequencing video shots in a way that maintains local video consistency and this is combined with exploitation of shot polysemy to enable shot reuse in a range of valid semantic contexts. Results of evaluations on output narratives using a shared set of video data show consistency in terms of local video sequences and global causality with no loss of generative power.