Music-ensemble robot that is capable of playing the theremin while listening to the accompanied music

Authors:
Takuma Otsuka;Takeshi Mizumoto;Kazuhiro Nakadai;Toru Takahashi;Kazunori Komatani;Tetsuya Ogata;Hiroshi G. Okuno
Affiliations:
Graduate School of Informatics, Kyoto University, Kyoto, Japan;Graduate School of Informatics, Kyoto University, Kyoto, Japan;Honda Research Institute Japan, Co., Ltd., Saitama, Japan;Graduate School of Informatics, Kyoto University, Kyoto, Japan;Graduate School of Informatics, Kyoto University, Kyoto, Japan;Graduate School of Informatics, Kyoto University, Kyoto, Japan;Graduate School of Informatics, Kyoto University, Kyoto, Japan
Venue:
IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I
Year:
2010

Citing 5
Cited 1

Music score alignment and computer accompaniment

Communications of the ACM - Music information retrieval
The interactive robotic percussionist: new developments in form, mechanics, perception and interaction design

Proceedings of the ACM/IEEE international conference on Human-robot interaction
Toward Robotic Musicianship

Computer Music Journal
Thereminist robot: development of a robot theremin player with feedforward and feedback arm control based on a Theremin’s pitch model

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Development of a aural real-time rhythmical and harmonic tracking to enable the musical interaction with the Waseda flutist robot

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems

Real-time audio-to-score alignment using particle filter for coplayer music robots

EURASIP Journal on Advances in Signal Processing - Special issue on musical applications of real-time signal processing

Quantified Score

Hi-index	0.01

Visualization

Abstract

Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP- 2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.