An interactive Whistle-to-Music composing system based on transcription, variation and chords generation

Authors:
Hung-Che Shen;Chung-Nan Lee
Affiliations:
Institute of Computer and Information Engineering, I-Shou University, Kaohsiung, People's Republic of China 840;Department of Computer Science and Engineering, National Sun Yat-Sen University, Kaohsiung, People's Republic of China 804
Venue:
Multimedia Tools and Applications
Year:
2011

Citing 9
Cited 0

Query by humming: musical information retrieval in an audio database

Proceedings of the third ACM international conference on Multimedia
Algorithmic composition as a model of creativity

Organised Sound
EyeMusic: making music with the eyes

NIME '04 Proceedings of the 2004 conference on New interfaces for musical expression
Sonification of facial actions for musical expression

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Non-speech input and speech recognition for real-time control of computer games

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
The vocal joystick: a voice-based human-computer interface for individuals with motor impairments

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Whistle for music: using melody transcription and approximate string matching for content-based query over a MIDI database

Multimedia Tools and Applications
MySong: automatic accompaniment generation for vocal melodies

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pitch in non-verbal vocal input

ACM SIGACCESS Accessibility and Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Most people can whistle, sing or hum a song that they are familiar with. However, it is rather difficult for common people without formal music skills or training to compose a song. In this paper, we have constructed an interactive Whistle-to-Music composing system with which a user can compose MIDI format music by whistling into a microphone. The user can experiment with computer-aided composition such as melodic variation and chords generation. The transcription speed is so fast that MIDI notes can be echoed as feedback immediately while the user is still whistling. For computer-aided composition, the given melodic fragments are developed and accompanied with stylish chords generation. We then study users' experiences and present the results of an experiment which tests how accurately people whistle along a target melody. This preliminary prototype of the proposed system is proved to be a handy tool for computer-aided MIDI music creation.