Detecting Violent Scenes in Movies by Auditory and Visual Cues

  • Authors:
  • Yu Gong;Weiqiang Wang;Shuqiang Jiang;Qingming Huang;Wen Gao

  • Affiliations:
  • Key Lab of Intell. Info. Process., Chinese Academy of Sciences, Beijing, China 100190 and Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China 100190 and Graduate School ...;Key Lab of Intell. Info. Process., Chinese Academy of Sciences, Beijing, China 100190 and Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China 100190 and Graduate School ...;Key Lab of Intell. Info. Process., Chinese Academy of Sciences, Beijing, China 100190 and Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China 100190;Key Lab of Intell. Info. Process., Chinese Academy of Sciences, Beijing, China 100190 and Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China 100190 and Graduate School ...;Graduate School of Chinese Academy of Sciences, Beijing, China 100190 and Institute of Digital Media, Peking University, Beijing, China 100871

  • Venue:
  • PCM '08 Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

To detect violence in movies, we present a three-stage method integrating visual and auditory cues. In our method, those shots with potential violent content are first identified according to universal film-making rules. A modified semi-supervised learning technique based on semi-supervised cross feature learning (SCFL) is exploited, since it is capable to combine different types of features and use unlabeled data to improve the classification performance. Then, typical violence-related audio effects are further detected for the candidate shots, and we manage to transform the confidences outputted by the classifiers of various audio events into a shot-based violence score. Finally, the first two-stage probabilistic outputs are integrated in a boosting way to generate the final inference. The experimental results on four typical action movies preliminarily show the effectiveness of our method.