Automated music video generation using multi-level feature-based segmentation

Authors:
Jong-Chul Yoon;In-Kwon Lee;Siwoo Byun
Affiliations:
Department of Computer Science, Yonsei University, Seoul, Korea;Department of Computer Science, Yonsei University, Seoul, Korea;Department of Digital Media, Anyang University, Anyang, Korea
Venue:
Multimedia Tools and Applications
Year:
2009

Citing 11
Cited 4

A Computational Approach to Edge Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Digital video processing

Digital video processing
Pattern recognition and image analysis

Pattern recognition and image analysis
A Model of Saliency-Based Visual Attention for Rapid Scene Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Creating music videos using automatic media analysis

Proceedings of the tenth ACM international conference on Multimedia
Pivot Vector Space Approach for Audio-Video Mixing

IEEE MultiMedia
Contrast-based image attention analysis by using fuzzy growing

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
AVE: automated home video editing

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Cati dance: self-edited, self-synchronized music video

ACM SIGGRAPH 2003 Sketches & Applications
Automatic music video generation based on temporal pattern analysis

Proceedings of the 12th annual ACM international conference on Multimedia
A novel motion-based representation for video mining

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03) - Volume 03

Toward an automatically generated soundtrack from low-level cross-modal correlations for automotive scenarios

Proceedings of the international conference on Multimedia
Example-based video remixing

Multimedia Tools and Applications
Example-based video remixing support system

MM '11 Proceedings of the 19th ACM international conference on Multimedia
The acousticvisual emotion guassians model for automatic generation of music video

Proceedings of the 20th ACM international conference on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

We show how to create a music video automatically, using computable characteristics of the video and music to promote coherent matching. We analyze the flow of both music and video, and then segment them into sequences of near-uniform flow. We extract features from the both video and music segments, and then find matching pairs. The granularity of the matching process can be adapted by extending the segmentation process to several levels. Our approach drastically reduces the skill required to make simple music videos.