MuseSync: standing on the shoulders of Hollywood

  • Authors:
  • Cynthia C. S. Liem;Alessio Bazzica;Alan Hanjalic

  • Affiliations:
  • Delft University of Technology, Delft, Netherlands;University of Firenze, Florence, Italy;Delft University of Technology, Delft, Netherlands

  • Venue:
  • Proceedings of the 20th ACM international conference on Multimedia
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this extended abstract, we present a novel story-driven approach to soundtrack retrieval for user-generated videos. Cinematic knowledge on cross-modal associations is exploited through folksonomic story text retrieval from collaborative online metadata resources. Subsequently, audiovisual synchronization is applied based on high-level features described by users. The approach is demonstrated in the MuseSync prototype system.