Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters

Authors:
Chutisant Kerdvibulvech;Hideo Saito
Affiliations:
Keio University, Hiyoshi, Kohoku-ku, Japan;Keio University, Hiyoshi, Kohoku-ku, Japan
Venue:
PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
Year:
2007

Citing 9
Cited 2

CONDENSATION—Conditional Density Propagation forVisual Tracking

International Journal of Computer Vision
Detecting Faces in Images: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
Computer Vision: A Modern Approach

Computer Vision: A Modern Approach
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System

IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
ARTag, a Fiducial Marker System Using Digital Techniques

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Tracking Multiple Colored Blobs with a Moving Camera

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Experiments with virtual reality instruments

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Visual methods for the retrieval of guitarist fingering

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Support system for guitar playing using augmented reality display

ISMAR '06 Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality

guitAR: supporting guitar learning through mobile projection

CHI '11 Extended Abstracts on Human Factors in Computing Systems
Using mobile projection to support guitar learning

SG'11 Proceedings of the 11th international conference on Smart graphics

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a vision-based method for tracking guitar fingerings played by guitar players from stereo cameras. We propose a novel framework for colored finger markers tracking by integrating a Bayesian classifier into particle filters, with the advantages of performing automatic track initialization and recovering from tracking failures in a dynamic background. ARTag (Augmented Reality Tag) is utilized to calculate the projection matrix as an online process which allow guitar to be moved while playing. By using online adaptation of color probabilities, it is also able to cope with illumination changes.