Music thumbnailing incorporating harmony- and rhythm structure

Authors:
Björn Schuller;Florian Dibiasi;Florian Eyben;Gerhard Rigoll
Affiliations:
Institute for Human-Machine Communication, Technische Universität München, München, Germany;Institute for Human-Machine Communication, Technische Universität München, München, Germany;Institute for Human-Machine Communication, Technische Universität München, München, Germany;Institute for Human-Machine Communication, Technische Universität München, München, Germany
Venue:
AMR'08 Proceedings of the 6th international conference on Adaptive Multimedia Retrieval: identifying, Summarizing, and Recommending Image and Music
Year:
2008

Citing 9
Cited 1

Visualizing music and audio using self-similarity

MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
The Spiral Array: An Algorithm for Determining Key Boundaries

ICMAI '02 Proceedings of the Second International Conference on Music and Artificial Intelligence
A hybrid music retrieval system using belief networks to integrate multimodal queries and contextual knowledge

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Music summarization using key phrases

ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 02
Towards user-adaptive structuring and organization of music collections

AMR'08 Proceedings of the 6th international conference on Adaptive Multimedia Retrieval: identifying, Summarizing, and Recommending Image and Music
Automatic synchronization between audio and partial music score representation

AMR'08 Proceedings of the 6th international conference on Adaptive Multimedia Retrieval: identifying, Summarizing, and Recommending Image and Music
Acoustic Chord Transcription and Key Extraction From Audio Using Key-Dependent HMMs Trained on Synthesized Audio

IEEE Transactions on Audio, Speech, and Language Processing
A chorus section detection method for musical audio signals and its application to a music listening station

IEEE Transactions on Audio, Speech, and Language Processing
"The way it Sounds": timbre models for analysis and retrieval of music signals

IEEE Transactions on Multimedia

Audio chord labeling by musiological modeling and beat-synchronization

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo

Quantified Score

Hi-index	0.00

Visualization

Abstract

A variety of approaches exist to the automatic retrieval of the key part within a musical piece - its thumbnail. Most of these however do not use adequate modeling with respect to either harmony or rhythm. In this work we therefore introduce thumbnailing that aims at adequate musical feature modeling. The rhythmic structure is extracted to obtain a segmentation based on beats and bars by an IIR comb-filter bank. Further, we extract chroma energy distribution normalized statistics features of the segmented song improving performance with dB(A) and pitch correction. Harmonic similarities are determined by construction and analysis of a similarity matrix based on the normalized scalar product of the feature vectors. Last, thumbnails are found lending techniques from image processing. Extensive test runs on roughly 24 h of music reveal the high effectiveness of our approach.