Improving face recognition with genealogical and contextual data

  • Authors:
  • Ellie Rasmus;Richard Green

  • Affiliations:
  • University of Canterbury, Christchurch, New Zealand;University of Canterbury, Christchurch, New Zealand

  • Venue:
  • Proceedings of the 27th Conference on Image and Vision Computing New Zealand
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

The field of genealogy has embraced the move towards digitisation, with increasingly large quantities of historical photographs being digitised in an effort to both preserve and share with a wider audience. Genealogy software is prevalent, but while many programs support photograph management, none use face recognition to assist in the identification and tagging of individuals. Genealogy is in the unique position of possessing a rich source of context in the form of a family tree, that a face recognition engine can draw information from. We aim to improve the accuracy of face recognition results within a family photograph album through the use of a filter that uses available contextual information from a given family tree. We also use measures of co-occurrence, recurrence and relative physical distance of individuals within the album to accurately predict the identity of individuals. This novel use of genealogical data as context has provided encouraging results, with a 26% improvement in accuracy at hit list size 1 and a 21% improvement at size 5 over the use of face recognition alone, when identifying 348 faces against a database of 523 faces from a challenging dataset of 173 family photographs.