The role of tags and image aesthetics in social image search

  • Authors:
  • Pere Obrador;Xavier Anguera;Rodrigo de Oliveira;Nuria Oliver

  • Affiliations:
  • Telefonica Research, Barcelona, Spain;Telefonica Research, Barcelona, Spain;Telefonica Research, Barcelona, Spain;Telefonica Research, Barcelona, Spain

  • Venue:
  • WSM '09 Proceedings of the first SIGMM workshop on Social media
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In recent years, there has been a proliferation of consumer digital photographs taken and stored in both personal and online repositories. As the amount of user-generated digital photos increases, there is a growing need for efficient ways to search for relevant images to be shared with friends and family. Text-query based search approaches rely heavily on the similarity between the input textual query and the tags added by users to the digital content. Unfortunately, text-query based search results might include a large number of relevant photos, all of them containing very similar tags, but with varying levels of image quality and aesthetic appeal. In this paper we introduce an image re-ranking algorithm that takes into account the aesthetic appeal of the images retrieved by a consumer image sharing site search engine (Google's Picasa Web Album). In order to do so, we extend a state-of-the-art image aesthetic appeal algorithm by incorporating a set of features aimed at consumer photographs. The results of a controlled user study with 37 participants reveal that image aesthetics play a varying role on the selected images depending on the query type and on the user preferences.