Automatic Appropriate Segment Extraction from Shots Based on Learning from Example Videos

  • Authors:
  • Yousuke Kurihara;Naoko Nitta;Noboru Babaguchi

  • Affiliations:
  • Graduate School of Engineering, Osaka University, Osaka, Japan 565-0871;Graduate School of Engineering, Osaka University, Osaka, Japan 565-0871;Graduate School of Engineering, Osaka University, Osaka, Japan 565-0871

  • Venue:
  • PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Videos are composed of shots, each of which is recorded continuously by a camera, and video editing can be considered as a process of re-sequencing shots selected from original videos. Shots usually include redundant intervals, which are often edited out by professional editors. Defining the intact interval which is used in the edited video as the appropriate segment and all other intervals of equal length as inappropriate segments, this paper proposes a method for automatically extracting appropriate segments from shots. Since what kinds of characteristics make an interval appropriate to be used in the edited video should be different among shots with different content, the proposed method firstly categorizes shots according to their content with Support Vector Machines. Then, the appropriate segments are extracted based on the temporal patterns of audio and visual features in appropriate and inappropriate segments learned with Hidden Markov Models for each shot category. The effectiveness of the proposed method is verified with experiments.