Using MIDI to modify video game content

Authors:
Jukka Holm;Juha Arrasvuori;Kai Havukainen
Affiliations:
Nokia Research Center, Tampere, Finland;Nokia Research Center, Tampere, Finland;Nokia Technology Platforms, Tampere, Finland
Venue:
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Year:
2006

Citing 4
Cited 3

Jam-O-World: evolution of the Jam-O-Drum multi-player musical controller into the Jam-O-Whirl gaming interface

NIME '02 Proceedings of the 2002 conference on New interfaces for musical expression
Contexts of collaborative musical experiences

NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
The convergence of alternate controllers and musical interfaces in interactive entertainment

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Personalizing game content using audio-visual media

Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology

Implementation and evaluation of a background music reactive game

IE '07 Proceedings of the 4th Australasian conference on Interactive entertainment
Towards Automated Game Design

AI*IA '07 Proceedings of the 10th Congress of the Italian Association for Artificial Intelligence on AI*IA 2007: Artificial Intelligence and Human-Oriented Computing
Background music reactive games

Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper discusses the concept of using background music to control video game parameters and thus actions on the screen. Each song selected by the player makes the game look different and behave variedly. The concept is explored by modifying an existing video game and playtesting it with different kinds of MIDI music. Several examples of mapping MIDI parameters to game events are presented. As mobile phones' MIDI players do not usually have a dedicated callback API, a real-time MIDI analysis software for Symbian OS was implemented. Future developments including real-time group performance as a way to control game content are also considered.