Generation of variations on theme music based on impressions of story scenes considering human's feeling of music and stories

Authors:
Kenkichi Ishizuka;Takehisa Onisawa
Affiliations:
Graduate School of Systems and Information Engineering, University of Tsukuba, Tennodai, Tsukuba, Japan;Graduate School of Systems and Information Engineering, University of Tsukuba, Tennodai, Tsukuba, Japan
Venue:
International Journal of Computer Games Technology - Joint International Conference on Cyber Games and Interactive Entertainment 2006
Year:
2008

Citing 4
Cited 0

A metadatabase system for semantic image search by a mathematical model of meaning

ACM SIGMOD Record
A model of textual affect sensing using real-world knowledge

Proceedings of the 8th international conference on Intelligent user interfaces
Media Converter with Impression Preservation Using a Neuro-Genetic Approach

International Journal of Hybrid Intelligent Systems
Generation of variations on theme music based on impressions of story scenes

Proceedings of the 2006 international conference on Game research and development

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a system which generates variations on theme music fitting to story scenes represented by texts and/or pictures. Inputs to the present system are original theme music and numerical information on given story scenes. The present system varies melodies, tempos, tones, tonalities, and accompaniments of given theme music based on impressions of story scenes. Genetic algorithms (GAs) using modular neural network (MNN) models as fitness functions are applied to music generation in order to reflect user's feeling of music and stories. The present system adjusts MNN models for each user on line. This paper also describes the evaluation experiments to confirm whether the generated variations on theme music reflect impressions of story scenes appropriately or not.