Semantic Video Summarization Using Mutual Reinforcement Principle and Shot Arrangement Patterns

  • Authors:
  • Shi Lu;Michael R. Lyu;Irwin King

  • Affiliations:
  • Chinese University of Hong Kong;Chinese University of Hong Kong;Chinese University of Hong Kong

  • Venue:
  • MMM '05 Proceedings of the 11th International Multimedia Modelling Conference
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a novel semantic video summarization framework, which generates video skimmings that guarantee both the balanced content coverage and the visual coherence. First, we collect video semantic information with a semi-automatic video annotation tool. Secondly, we analyze the video structure and determine each video sceneýs target skim length. Then, mutual reinforcement principle is used to compute the relative importance value and cluster the video shots according to their semantic descriptions. Finally, we analyze the arrangement pattern of the video shots, and the key shot arrangement patterns are extracted to form the final video skimming, where the video shot importance value is used as guidance. Experiments are conducted to evaluate the effectiveness of our proposed approach.