From usage to annotation: analysis of personal photo albums for semantic photo understanding

  • Authors:
  • Philipp Sandhaus;Susanne Boll

  • Affiliations:
  • OFFIS - Institute for Information Technology, Oldenburg, Germany;University of Oldenburg, Oldenburg, Germany

  • Venue:
  • WSM '09 Proceedings of the first SIGMM workshop on Social media
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

With photo albums we aim to capture personal events such as weddings, vacations, and parties of family and friends. By arranging photo prints, captions and paper souvenirs such as tickets over the pages of a photo book we tell a story to capture and share our memories. The photo memories captured in such a photo book tell us a lot about the content and the relevance of the photos for the user. The way in which we select photos and arrange them in the photo book reveal a lot about the events, persons and places on the photos: captions describe content, closeness and arrangement of photos express relations between photos and their content. These semantics of our personal stories, however, are canned in the photo book but would form a very valuable asset for understanding and annotating our personal media collection. In this paper, we present the results of the analysis of a large repository of digitally mastered photo books to learn about the usage of digital photos. From our analysis of the books' content we derive additional semantics for photos, groups of photos and entire photo albums. With this semantic knowledge not only additional metadata can be provided for the organization of the personal photo collection. Also, we can characterize photo books and support users to create even more handsome photo books from large media collections.