Naming faces in films using hypergraph matching

  • Authors:
  • Yi-Fan Zhang;Changsheng Xu;Jian Cheng;Hanqing Lu

  • Affiliations:
  • National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences and China-Singapore Institute of Digital Media;National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences and China-Singapore Institute of Digital Media;National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences and China-Singapore Institute of Digital Media;National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences and China-Singapore Institute of Digital Media

  • Venue:
  • ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we aim to address the problem of naming faces in feature-length films using video and film script. Different from the state-of-the-art methods on naming faces in the videos, most of which used a local matching between a visible face and one of the names extracted from the local video transcript, we use a global matching between names and faces as it is not easy to obtain enough local name cues in the films. In the video, we cluster the faces into groups corresponding to characters and build a face network according to face co-occurrence relationship. Similarly in the film script, a name network is also built according to name co-occurrence relationship. The vertices of the two networks are finally matched by a hypergraph matching method. Experiments are conducted on five feature-length films and give encouraging results.