Query by humming: musical information retrieval in an audio database
Proceedings of the third ACM international conference on Multimedia
Towards the digital music library: tune retrieval from acoustic input
Proceedings of the first ACM international conference on Digital libraries
STAIRS redux: thoughts on the STAIRS evaluation, ten years after
Journal of the American Society for Information Science - Special issue: evaluation of information retrieval systems
A tool for content based navigation of music
MULTIMEDIA '98 Proceedings of the sixth ACM international conference on Multimedia
How reliable are the results of large-scale information retrieval experiments?
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Content-based retrieval for music collections
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Melodic matching techniques for large music databases
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Musical content-based retrieval: an overview of the Melodiscov approach and system
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Managing gigabytes (2nd ed.): compressing and indexing documents and images
Managing gigabytes (2nd ed.): compressing and indexing documents and images
Music ranking techniques evaluated
ACSC '02 Proceedings of the twenty-fifth Australasian conference on Computer science - Volume 4
Design Patterns for Interactive Musical Systems
IEEE MultiMedia
Query by Rhythm: An Approach for Song Retrieval in Music Databases
RIDE '98 Proceedings of the Workshop on Research Issues in Database Engineering
Music Databases: Indexing Techniques and Implementation
IW-MMDBMS '96 Proceedings of the 1996 International Workshop on Multi-Media Database Management Systems (IW-MMDBMS '96)
Retrieval evaluation with incomplete information
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Effectiveness of note duration information for music retrieval
DASFAA'05 Proceedings of the 10th international conference on Database Systems for Advanced Applications
| Hi-index | 0.00 |
There have been many proposed music-retrieval systems, based on a variety of principles. How the effectiveness of these systems compares is not clear. The evaluation of some systems has been informal, without the rigor applied in other areas of information retrieval, and comparison of systems is difficult because of the lack of a common data set, queries, or relevance judgments. In this paper we explain how we collected artificial and expert music queries and name-based relevance judgments, and describe software we developed for collection of manual relevance judgments. Together with a collection of downloaded musical instrument digital interface (MIDI) files, these sets of queries and relevance judgments provide valuable tools for measuring music-retrieval systems. As an example of the value of these tools, we use them to compare the effect of using the expert queries and manual judgments to that of the artificial queries and manual judgments used in our earlier experiments.