Mining Association Patterns between Music and Video Clips in Professional MTV

  • Authors:
  • Chao Liao;Patricia P. Wang;Yimin Zhang

  • Affiliations:
  • Tsinghua University, Beijing, China 100084;Intel China Research Center, Beijing, China 100080;Intel China Research Center, Beijing, China 100080

  • Venue:
  • MMM '09 Proceedings of the 15th International Multimedia Modeling Conference on Advances in Multimedia Modeling
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Video and music clips in MTV match together in particular ways to produce attractive effect. In this paper, we use a dual-wing harmonium model to learn and represent the underlying association patterns between music and video clips in professional MTV. We also use the discovered patterns to facilitate automatic MTV generation. Provided with a raw video and certain professional MTV as template, we generate a new MTV by efficiently inferring the most related video clip for every music clip based on the trained model. Our method shows encouraging result compared with other automatic MTV generation approach.