An interactive and multi-level framework for summarising user generated videos

  • Authors:
  • Saman H. Cooray;Hervé Bredin;Li-Qun Xu;Noel E. O'Connor

  • Affiliations:
  • Dublin City Univerisity, Dublin, Ireland;Institut de Recherche en Informatique de Toulouse, Toulouse, France;British Telecommunications Plc, Ipswich, United Kingdom;Dublin City Univerisity, Dublin, Ireland

  • Venue:
  • MM '09 Proceedings of the 17th ACM international conference on Multimedia
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an interactive and multi-level abstraction framework for user-generated video (UGV) summarisation, allowing a user the flexibility to select a summarisation criterion out of a number of methods provided by the system. First, a given raw video is segmented into shots, and each shot is further decomposed into sub-shots in line with the change in dominant camera motion. Secondly, principal component analysis (PCA) is applied to the colour representation of the collection of sub-shots, and a content map is created using the first few components. Each sub-shot is represented with a "footprint" on the content map, which reveals its content significance (coverage) and the most dynamic segment. The final stage of abstraction is devised in a user-assisted manner whereby a user is able to specify a desired summary length, with options to interactively perform abstraction at different granularity of visual comprehension. The results obtained show the potential benefit in significantly alleviating the burden of laborious user intervention associated with conventional video editing/browsing.