Audio-video analysis of musical expressive intentions

Authors:
Ingrid Visentini;Antonio Rodà;Sergio Canazza;Lauro Snidaro
Affiliations:
University of Udine, Dept. of Mathematics and Computer Science, Udine, Italy;University of Udine, Dept. of Mathematics and Computer Science, Udine, Italy;University of Padova, Dept. of Information Engineering, Padova, Italy;University of Udine, Dept. of Mathematics and Computer Science, Udine, Italy
Venue:
ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing - Volume Part II
Year:
2011

Citing 4
Cited 0

Communicating Expressiveness and Affect in Multimodal Interactive Systems

IEEE MultiMedia
Music retrieval: a tutorial and review

Foundations and Trends in Information Retrieval
A survey of computer systems for expressive music performance

ACM Computing Surveys (CSUR)
Score-Independent Audio Features for Description of Music Expression

IEEE Transactions on Audio, Speech, and Language Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a preliminary study on the relation between audiovideo streams and high-level information related to expressive nuances. A violinist was asked to play three musical excerpts several times, each one inspired by one of nine different expressive intentions. Perceptual tests was carried out using both audio-only and audio-visual recordings of the performances. The results demonstrate that the visual component aids the subjects to better recognize the different expressive intentions of the musical performances, showing that the fusion of audio-visual information can significantly improve the degree of recognition given by single means.