Shot boundary detection for H.264/AVC bitstreams with frames containing multiple types of slices

  • Authors:

  • Sarah De Bruyne;Wesley De Neve;Davy De Schrijver;Peter Lambert;Piet Verhoeve;Rik Van de Walle

  • Affiliations:

  • Ghent University - IBBT, Department of Electronics and Information Systems - Multimedia Lab, Ledeberg-Ghent, Belgium;Ghent University - IBBT, Department of Electronics and Information Systems - Multimedia Lab, Ledeberg-Ghent, Belgium;Ghent University - IBBT, Department of Electronics and Information Systems - Multimedia Lab, Ledeberg-Ghent, Belgium;Ghent University - IBBT, Department of Electronics and Information Systems - Multimedia Lab, Ledeberg-Ghent, Belgium;Televic, Izegem, Belgium;Ghent University - IBBT, Department of Electronics and Information Systems - Multimedia Lab, Ledeberg-Ghent, Belgium

  • Venue:
  • PCM'07 Proceedings of the multimedia 8th Pacific Rim conference on Advances in multimedia information processing
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, a novel shot boundary detection algorithm is introduced for H.264/AVC bitstreams. This algorithm relies on features present in a compressed video bitstream, i.e., macroblock types and reference directions. In contrast to existing algorithms, the proposed technique is able to analyze bitstreams with frames containing different types of slices. To deal with such frames, formulas are presented that work on inter- and intra-coded slices. The results obtained for the different types of slices are combined by calculating a linear combination, taking into account their size. This way, a metric is found that can be used for the automatic detection of shot boundaries. Results show that the proposed algorithm has a high accuracy in terms of recall and precision for video sequences with frames containing multiple slice types.