Interacting with a virtual conductor

Authors:
Pieter Bos;Dennis Reidsma;Zsófia Ruttkay;Anton Nijholt
Affiliations:
HMI, Dept. of CS, University of Twente, Enschede, The Netherlands;HMI, Dept. of CS, University of Twente, Enschede, The Netherlands;HMI, Dept. of CS, University of Twente, Enschede, The Netherlands;HMI, Dept. of CS, University of Twente, Enschede, The Netherlands
Venue:
ICEC'06 Proceedings of the 5th international conference on Entertainment Computing
Year:
2006

Citing 5
Cited 5

Inside the "conductor's jacket": analysis, interpretation and musical synthesis of expressive gesture

Inside the "conductor's jacket": analysis, interpretation and musical synthesis of expressive gesture
Learning kernel-based HMMs for dynamic sequence synthesis

Graphical Models - Special issue on Pacific graphics 2002
A Review of Automatic Rhythm Description Systems

Computer Music Journal
Analysis of the meter of acoustic musical signals

IEEE Transactions on Audio, Speech, and Language Processing
An experimental comparison of audio tempo induction algorithms

IEEE Transactions on Audio, Speech, and Language Processing

Psychological responses to simulated displays of mismatched emotional expressions

Interacting with Computers
Beyond the beat: modelling intentions in a virtual conductor

Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINment
Mutually Coordinated Anticipatory Multimodal Interaction

Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction
Challenges for virtual humans in human computing

ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Playing and cheating in ambient entertainment

ICEC'07 Proceedings of the 6th international conference on Entertainment Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a virtual embodied agent that can conduct musicians in a live performance. The virtual conductor conducts music specified by a MIDI file and uses input from a microphone to react to the tempo of the musicians. The current implementation of the virtual conductor can interact with musicians, leading and following them while they are playing music. Different time signatures and dynamic markings in music are supported.