A Novel Role-Based Movie Scene Segmentation Method

  • Authors:

  • Chao Liang;Yifan Zhang;Jian Cheng;Changsheng Xu;Hanqing Lu

  • Affiliations:

  • National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190;National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190;National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190;National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190;National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190

  • Venue:
  • PCM '09 Proceedings of the 10th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Semantic scene segmentation is a crucial step in movie video analysis and extensive research efforts have been devoted to this area. However, previous methods are heavily relying on video content itself, which are lack of objective evaluation criterion and necessary semantic link due to the semantic gap. In this paper, we propose a novel role-based approach for movie scene segmentation using script. Script is a text description of movie content that contains the scene structure information and related character names, which can be regarded as an objective evaluation criterion and useful external reference. The main novelty of our approach is that we convert the movie scene segmentation into a movie-script alignment problem and propose a HMM alignment algorithm to map the script scene structure to the movie content. The promising results obtained from three Hollywood movies demonstrate the effectiveness of our proposed approach.