A unified framework using spatial color descriptor and motion-based post refinement for shot boundary detection

  • Authors:

  • Wei-Ta Chu;Wen-Huang Cheng;Sheng-Fang He;Chia-Wei Wang;Ja-Ling Wu

  • Affiliations:

  • Department of Computer Science and Information Engineering, National Taiwan University;Graduate Institute of Networking and Multimedia, National Taiwan University;Department of Computer Science and Information Engineering, National Taiwan University;Department of Computer Science and Information Engineering, National Taiwan University;Department of Computer Science and Information Engineering, National Taiwan University

  • Venue:
  • PCM'04 Proceedings of the 5th Pacific Rim conference on Advances in Multimedia Information Processing - Volume Part III
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a unified framework which combines a novel color representation, i.e. spatial color descriptors, and a post-refinement process to detect various types of shot boundaries, including abrupt shot changes, flashlights, dissolves, fade-ins and fade-outs. The spatial color descriptor involving color adjacency and color vector angle histograms incorporates spatial information into color representation and provides robust performance in shot boundary detection. Moreover, a motion-based post-refinement process is developed to effectively eliminate false positives in gradual transition detection, where rapid camera motion or object movement may lead to performance degradation. Experimental results show that these two techniques are integrated seamlessly to give satisfactory performance and present the robustness of spatial color descriptors.