Context-aware person identification in personal photo collections

  • Authors:

  • Neil O'Hare;Alan F. Smeaton

  • Affiliations:

  • Centre for Digital Video Processing at Dublin City University, Glasnevin, Dublin, Ireland;Centre for Digital Video Processing and CLARITY, The Centre for Sensor Web Technologie, Dublin City University, Dublin, Ireland

  • Venue:
  • IEEE Transactions on Multimedia - Special issue on integration of context and content
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Identifying the people in photos is an important need for users of photo management systems. We present MediAssist, one such system which facilitates browsing, searching and semi-automatic annotation of personal photos, using analysis of both image content and the context in which the photo is captured. This semiautomatic annotation includes annotation of the identity of people in photos. In this paper, we focus on such person annotation, and propose person identification techniques based on a combination of context and content. We propose language modelling and nearest neighbor approaches to context-based person identification, in addition to novel face color and image color content-based features (used alongside face recognition and body patch features). We conduct a comprehensive empirical study of these techniques using the real private photo collections of a number of users, and show that combining context- and content-based analysis improves performance over content or context alone.