Robust temporal and spectral modeling for query By melody

  • Authors:
  • Shai Shalev-Shwartz;Shlomo Dubnov;Nir Friedman;Yoram Singer

  • Affiliations:
  • Hebrew University, Jerusalem, Israel;Ben-Gurion University, Beér-Sheva,Israel;Hebrew University, Jerusalem, Israel;Hebrew University, Jerusalem, Israel

  • Venue:
  • SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

Query by melody is the problem of retrieving musical performances from melodies. Retrieval of real performances is complicated due to the large number of variations in performing a melody and the presence of colored accompaniment noise. We describe a simple yet effective probabilistic model for this task. We describe a generative model that is rich enough to capture the spectral and temporal variations of musical performances and allows for tractable melody retrieval. While most of previous studies on music retrieval from melodies were performed with either symbolic (e.g. MIDI) data or with monophonic (single instrument) performances, we performed experiments in retrieving live and studio recordings of operas that contain a leading vocalist and rich instrumental accompaniment. Our results show that the probabilistic approach we propose is effective and can be scaled to massive datasets.