A picture is worth a thousand keywords: exploring mobile image-based web search

  • Authors:

  • Konrad Tollmar;Ted Möller;Björn Nilsved

  • Affiliations:

  • Lund University, Lund, Sweden;Sony Ericsson Mobile Communications, Lund, Sweden;Epineer, Malmö, Sweden

  • Venue:
  • Proceedings of the 9th international conference on Human computer interaction with mobile devices and services
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Images of objects as queries is a new approach to search for information on the web. Image-based information retrieval goes beyond only matching images, as information in other modalities also can be extracted from data collections using image search. We have developed a new system that uses images to search for web-based information. This paper has a particular focus towards exploring user's experience of general mobile image-based Web searches to find what issues and phenomena it contains. This was achieved in a multi-part study by creating and letting respondents test prototypes of mobile image-based search systems and collecting data using interviews, observations, video-observations, and questionnaires. We observed that searching for information only based on visual similarity and without any assistance is sometimes difficult, especially on mobile devices with limited interaction bandwidth. Most of our subjects preferred a search tool that guides the users through the search result based on contextual information, compared to presenting the search result as a plain ranked list.