Detection of documentary scene changes by audio-visual fusion

  • Authors:
  • Atulya Velivelli;Chong-Wah Ngo;Thomas S. Huang

  • Affiliations:
  • Beckman Institute for Advanced Science and Technology, Urbana;City University of Hong Kong, Hong Kong;Beckman Institute for Advanced Science and Technology, Urbana

  • Venue:
  • CIVR'03 Proceedings of the 2nd international conference on Image and video retrieval
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

The concept of a documentary scene was inferred from the audio-visual characteristics of certain documentary videos. It was observed that the amount of information from the visual component alone was not enough to convey a semantic context to most portions of these videos, but a joint observation of the visual component and the audio component conveyed a better semantic context. From the observations that we made on the video data, we generated an audio score and a visual score. We later generated a weighted audio-visual score within an interval and adaptively expanded or shrunk this interval until we found a local maximum score value. The video ultimately will be divided into a set of intervals that correspond to the documentary scenes in the video. After we obtained a set of documentary scenes, we made a check for any redundant detections.