An intelligent virtual piano tutor

Authors:
Chih-Chun Lin;Damon Shing-Min Liu
Affiliations:
Chung Cheng University, Chiayi, Taiwan;Chung Cheng University, Chiayi, Taiwan
Venue:
Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications
Year:
2006

Citing 7
Cited 1

Research in music and artificial intelligence

ACM Computing Surveys (CSUR)
Interactive control of avatars animated with human motion data

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Snap-together motion: assembling run-time animations

I3D '03 Proceedings of the 2003 symposium on Interactive 3D graphics
Neural Network-Based Violinist's Hand Animation

CGI '00 Proceedings of the International Conference on Computer Graphics
Construction and animation of anatomically based human hand models

Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Handrix: animating the human hand

Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Physically based grasping control from example

Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation

Duet for solo piano: MirrorFugue for single user playing with recorded performances

CHI '11 Extended Abstracts on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Aiming to instruct the novice in good playing of musical instruments, tutors need to teach the students how to practice certain fingering for certain notes sequence, which typically is the most difficult skill for a beginner to learn. In this paper, we illustrate a virtual piano tutoring system. The system takes a MIDI event sequence as input and displays the suggested result by a 3D virtual pianist, demonstrating the automatically generated "good" fingering for the learner to imitate.Most previous fingering solving algorithms have drawbacks. First, all them solve the fingering piece by piece off-line. Second, the goodness evaluation function is hard to model. Third, no polyphonic algorithm is ever presented. This paper describes a new framework which remedies the first two drawbacks and is of potnetial to solve polyphonic sequence using a novel fingering generation mechanism SFG(Slicing Fingering Generation). Our system gets the fingering solving in real-time, and provides an ergonomics-based pose evaluation.