Exploring Music Video Editing Rules with Dual-Wing Harmonium Model

  • Authors:
  • Chao Liao;Patricia P. Wang;Yimin Zhang

  • Affiliations:
  • Tsinghua University, Beijing, China 100084;Intel China Research Center, Beijing, China 100080;Intel China Research Center, Beijing, China 100080

  • Venue:
  • PCM '08 Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automatic music video editing is still a challenging task due to the lack of knowledge of how music and video are matched to produce attractive effects. Previous works usually matches music and video following assumption or empirical knowledge. In this paper, we use a dual-wing harmonium model to learn and represent the underlying music video editing rules from a large dataset of music videos. The editing rules are extracted by clustering the low dimensional representation of music video clips. In the experiments, we give an intuitive visualization for the discovered editing rules. These editing rules partially reflect professional music video editor's skills and can be used to further improve the quality of automatically generated music video.