Visual language model for face clustering in consumer photos

  • Authors:

  • Wei-Ta Chu;Ya-Lin Lee;Jen-Yu Yu

  • Affiliations:

  • National Chung Cheng University, Chiayi, Taiwan Roc;National Chung Cheng University, Chiayi, Taiwan Roc;Industrial Technology Research Inst., Hsinchu, Taiwan Roc

  • Venue:
  • MM '09 Proceedings of the 17th ACM international conference on Multimedia
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

For consumer photos, this work clusters faces with large variations in lighting, pose, and expression. After matching face images by local feature points, we transform matching situations into a novel representation called visual sentences. Then, visual language models are constructed to describe the dependency of image patches on faces. With the probabilistic framework, we develop a clustering algorithm to group the same individual's face images into the same cluster. An interesting observation about evaluating face clustering performance is proposed, and we demonstrate the superiority of the proposed visual language model approach.