Automatic synthesis of background music track data by analysis of video contents

  • Authors:

  • Toshio Modegi

  • Affiliations:

  • Research & Development Center, Dai Nippon Printing Co., Ltd., Chiba, Japan

  • Venue:
  • PCM'04 Proceedings of the 5th Pacific Rim conference on Advances in Multimedia Information Processing - Volume Part III
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes an automatic creation technique of background music track data for given video file. Our proposed system is based on a novel BGM synthesizer, called “Matrix Music Player”, which can produce 3125 kinds of high-quality BGM contents by dynamically mixing 5 audio files, which are freely selected from total 25 audio waveform files. In order to retrieve an appropriate BGM mixing patterns, we have constructed an acoustic analysis database, which records acoustic features of total 3125 synthesized patterns. Developing a video analyzer which generates image parameters of given video data and converts them to acoustic parameters, we access the acoustic analysis database and retrieve an appropriate synthesized BGM signal, which can be included in the audio track of the source video file.