Multimedia event recounting with concept based representation

  • Authors:
  • Qian Yu;Jingen Liu;Hui Cheng;Ajay Divakaran;Harpreet Sawhney

  • Affiliations:
  • SRI International Sarnoff, Princeton, NJ, USA;SRI International Sarnoff, Princeton, NJ, USA;SRI International Sarnoff, Princeton, NJ, USA;SRI International Sarnoff, Princeton, NJ, USA;SRI International Sarnoff, Princeton, NJ, USA

  • Venue:
  • Proceedings of the 20th ACM international conference on Multimedia
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multimedia event detection has drawn a lot of attention in recent years. Given a recognized event, in this paper, we conduct a pilot study of the multimedia event recounting problem, which answers the question why this video is recognized as this event, i.e. what evidences this decision is made on. In order to provide a semantic recounting of the multimedia event, we adopt a concept-based event representation for learning a discriminative event model. Then, we present a recounting approach that exactly recovers the contribution of semantic evidence to the event classification decision. This approach can be applied on any additive discriminative classifiers. The promising result is shown on the MED11 dataset that contains 15 events in thousands of YouTube like videos.