Feature-based synchronization of video and background music

  • Authors:
  • Jong-Chul Yoon;In-Kwon Lee;Hyun-Chul Lee

  • Affiliations:
  • Dept. of Computer Science, Yonsei University, Korea;Dept. of Computer Science, Yonsei University, Korea;Dept. of Computer Science, Yonsei University, Korea

  • Venue:
  • IWICPAS'06 Proceedings of the 2006 Advances in Machine Vision, Image Processing, and Pattern Analysis international conference on Intelligent Computing in Pattern Analysis/Synthesis
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We synchronize background music with a video by changing the timing of music, an approach that minimizes the damage to music data. Starting from a MIDI file and video data, feature points are extracted from both sources, paired, and then synchronized using dynamic programming to time-scale the music. We also introduce the music graph, a directed graph that encapsulates connections between many short music sequences. By traversing a music graph, we can generate large amounts of new background music, in which we expect to find a sequence which matches the video features better than the original music.