The visual analysis of human movement: a survey
Computer Vision and Image Understanding
Human motion analysis: a review
Computer Vision and Image Understanding
A Bayesian Computer Vision System for Modeling Human Interactions
IEEE Transactions on Pattern Analysis and Machine Intelligence
Non-obvious Performer Gestures in Instrumental Music
GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Quantitative Analysis of Non-obvious Performer Gestures
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Recognition and Verification of Unconstrained Handwritten Words
IEEE Transactions on Pattern Analysis and Machine Intelligence
Visual methods for the retrieval of guitarist fingering
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Real-time adaptive background segmentation
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03) - Volume 03
Computer Vision Method in Music Interaction
MMEDIA '09 Proceedings of the 2009 First International Conference on Advances in Multimedia
Expert Systems with Applications: An International Journal
Human activity monitoring by local and global finite state machines
Expert Systems with Applications: An International Journal
Expert Systems with Applications: An International Journal
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Handy: A real-time three color glove-based gesture recognizer with learning vector quantization
Expert Systems with Applications: An International Journal
Detecting moving objects, ghosts, and shadows in video streams
IEEE Transactions on Pattern Analysis and Machine Intelligence
Hi-index | 12.05 |
A novel approach for the detection of ancillary gestures produced by clarinetists during musical performances is presented in this paper. Ancillary gestures, also known as non-obvious or accompanist gestures are produced spontaneously by musicians during their performances and do not have meaning in sound, but they help in the creation of music. The proposed approach consists in detecting, segmenting and tracking points of interest and parts of the musician body in video scenes to further analyze if the movement associated to these points of interest or body parts could be related to ancillary gestures. In particular, we tackle the problem of detecting the three most commonly seen ancillary gestures of this class of musicians: clarinet bell moving up and down, bending of the knees and shoulder curvature. In this paper we show that the optical flux algorithm for tracking a point of interest at the bottom of the clarinet bell and the projection profile algorithm for analyzing the knees and the shoulder regions are effective in detecting ancillary movements related to the clarinet, knee movement and body curvature respectively. These techniques were evaluated with respect to the precision and recall in detecting ancillary gestures on 12,423 video frames of nine clarinetists' presentations recorded in a studio. The experimental results have shown that the precision in detecting ancillary gestures varies between 78.4% and 92.8%, while the recall varies between 85.3% and 95.5%. These results also imply that any further analysis of the videos by specialists could focus on less than 500 frames which represents a reduction of more than 99% in the workload.