Markov random fields for sketch based video retrieval

  • Authors:
  • Rui Hu;Stuart James;Tinghuai Wang;John Collomosse

  • Affiliations:
  • university of surrey, guildford, United Kingdom;university of surrey, guildford, United Kingdom;university of surrey, guildford, United Kingdom;university of surrey, guildford, United Kingdom

  • Venue:
  • Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe a new system for searching video databases using free-hand sketched queries. Our query sketches depict both object appearance and motion, and are annotated with keywords that indicate the semantic category of each object. We parse space-time volumes from video to form graph representation, which we match to sketches under a Markov Random Field (MRF) optimization. The MRF energy function is used to rank videos for relevance and contains unary, pairwise and higher-order potentials that reflect the colour, shape, motion and type of sketched objects. We evaluate performance over a dataset of 500 sports footage clips.