Query by humming: musical information retrieval in an audio database
Proceedings of the third ACM international conference on Multimedia
An introduction to genetic algorithms
An introduction to genetic algorithms
Melodic matching techniques for large music databases
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
A problem-oriented and rule-based component repository
Journal of Systems and Software
Kendra: adaptive Internet system
Journal of Systems and Software
Journal of Systems and Software
ACM Transactions on Computer-Human Interaction (TOCHI)
Modern Information Retrieval
Implementation of relevance feedback for content-based music retrieval based on user prefences
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Genetic algorithm-based relevance feedback for image retrieval using local similarity patterns
Information Processing and Management: an International Journal
Order-based fitness functions for genetic algorithms applied to relevance feedback
Journal of the American Society for Information Science and Technology
Computer Science in Perspective
An inexact model matching approach and its applications
Journal of Systems and Software
Personalization of user profiles for content-based music retrieval based on relevance feedback
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
FMF: Query adaptive melody retrieval system
Journal of Systems and Software
IEEE Transactions on Audio, Speech, and Language Processing
Relevance feedback: a power tool for interactive content-based image retrieval
IEEE Transactions on Circuits and Systems for Video Technology
COMUS: Ontological and Rule-Based Reasoning for Music Recommendation System
PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
Music emotion classification and context-based music recommendation
Multimedia Tools and Applications
A novel approach based on fault tolerance and recursive segmentation to query by humming
AST/UCMA/ISA/ACN'10 Proceedings of the 2010 international conference on Advances in computer science and information technology
The Journal of Supercomputing
Hi-index | 0.00 |
So far, many researches have been done to develop efficient music retrieval systems, and query-by-humming has been considered as one of the most intuitive and effective query methods for music retrieval. For the voice humming to be a reliable query source, elaborate signal processing and acoustic similarity measurement schemes are necessary. On the other hand, recently, there has been an increased interest in query reformulation using relevance feedback with evolutionary techniques such as genetic algorithm for multimedia information retrieval. However, these techniques have not been exploited widely in the field of music retrieval. In this paper, we develop a novel music retrieval system called MUSEMBLE (MUSic enEMBLE) based on two distinct features: (i) A sung or hummed query is automatically transcribed into a sequence of pitch and duration pairs with improved accuracy for music representation. More specifically, we developed two new and unique techniques called WAE (windowed average energy) and dynamic ADF (amplitude-based difference function) onsets for more accurate note segmentation and onset/offset detection in acoustic signal, respectively. The former improved energy-based approaches such as AE by defining small but coherent windows with local and global threshold values. On the other hand, the latter improved the AF (amplitude function) that calculates the summation of the absolute values of signal differences for the clustering energy contour. (ii) A user query is reformulated using user relevance feedback with a genetic algorithm to improve retrieval performance. Even though we have especially focused on humming queries in this paper, MUSEMBLE provides versatile query and browsing interfaces for various kinds of users. We have carried out extensive experiments on the prototype system to evaluate the performance of our voice query transcription and genetic algorithm-based relevance feedback schemes. We demonstrate that our proposed method improves the retrieval accuracy up to 20-40% compared with other popular RF methods. We also show that both WAE and Dynamic ADF methods improve the transcription accuracy up to 95%.