Multimedia information seeking through search and hyperlinking

  • Authors:

  • Maria Eskevich;Gareth J.F. Jones;Robin Aly;Roeland J.F. Ordelman;Shu Chen;Danish Nadeem;Camille Guinaudeau;Guillaume Gravier;Pascale Sébillot;Tom de Nies;Pedro Debevere;Rik Van de Walle;Petra Galuscakova;Pavel Pecina;Martha Larson

  • Affiliations:

  • Dublin City University, Dublin, Ireland;Dublin City Univesity, Dublin, Ireland;University of Twente, Enschede, Netherlands;University of Twente, Enschede, Netherlands;Dublin City University, Dublin, Ireland;University of Twente, Enschede, Netherlands;IRISA/University of Rennes 1, Rennes, France;IRISA/CNRS, Rennes, France;IRISA/INSA, Rennes, France;Ghent University, Ghent, Belgium;Ghent University, Ghent, Belgium;Ghent University, Ghent, Belgium;Charles University in Prague, Prague, Czech Rep;Charles University in Prague, Prague, Czech Rep;Delft University of Technology, Delft, Netherlands

  • Venue:
  • Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Searching for relevant webpages and following hyperlinks to related content is a widely accepted and effective approach to information seeking on the textual web. Existing work on multimedia information retrieval has focused on search for individual relevant items or on content linking without specific attention to search results. We describe our research exploring integrated multimodal search and hyperlinking for multimedia data. Our investigation is based on the MediaEval 2012 Search and Hyperlinking task. This includes a known-item search task using the Blip10000 internet video collection, where automatically created hyperlinks link each relevant item to related items within the collection. The search test queries and link assessment for this task was generated using the Amazon Mechanical Turk crowdsourcing platform. Our investigation examines a range of alternative methods which seek to address the challenges of search and hyperlinking using multimodal approaches. The results of our experiments are used to propose a research agenda for developing effective techniques for search and hyperlinking of multimedia content.