Toward an understanding of similarity judgments for music digital library evaluation

Authors:
J. Stephen Downie;Jin Ha Lee;Anatoliy A. Gruzd;M. Cameron Jones
Affiliations:
University of Illinois at Urbana-Champaign, Champaign, IL;University of Illinois at Urbana-Champaign, Champaign, IL;University of Illinois at Urbana-Champaign, Champaign, IL;University of Illinois at Urbana-Champaign, Champaign, IL
Venue:
Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
Year:
2007

Citing 1
Cited 1

Measuring retrieval effectiveness: a new proposal and a first experimental validation

Journal of the American Society for Information Science and Technology

Analysis of user needs and information features in natural language queries seeking music information

Journal of the American Society for Information Science and Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an analysis of 7,602 similarity judgments collected for the Symbolic Melodic Similarity (SMS) and Audio Music Similarity and Retrieval (AMS) evaluation tasks in the 2006 Music Information Retrieval Evaluation eXchange (MIREX). We discuss the influence of task definitions, as well as evaluation metrics on user perceptions of music similarity, and provide recommendations for future Music Digital Library/Music Information Retrieval research pertaining to music similarity.