Movie Event Detection by Using Audio Visual Information

  • Authors:
  • Ying Li;C. C. Jay Kuo

  • Affiliations:
  • -;-

  • Venue:
  • PCM '01 Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work focuses on the detection of events including 2- speaker dialog scene, multiple-speaker dialog scene and hybrid scene from the daily movies. Specifically, we employ the visual information to detect all possible shot sinks by using a new method called a window-based sweep algorithm, then all detected shot sinks are categorized into 3 classes using the well-known K-means algorithm, which forms the basis of our proposed event-detection scheme. Furthermore, the accompanying audio cue will also be utilized for achieving more meaningful results. Our preliminary experimental results show that by integrating audiovisual information, meaningful events could be successfully detected and extracted.