Automatic photo indexing based on person identity

  • Authors:
  • Seungji Yang;Kyong Sok Seo;Sang Kyun Kim;Yong Man Ro;Ji-Yeon Kim;Yang Suk Seo

  • Affiliations:
  • Image and Video Systems Lab., Information and Communications University (ICU), Daejeon, South Korea;Image and Video Systems Lab., Information and Communications University (ICU), Daejeon, South Korea;Computing Lab., Digital Research Center, Samsung Advanced Institute of Technology (SAIT), Kyunggi, South Korea;Image and Video Systems Lab., Information and Communications University (ICU), Daejeon, South Korea;Computing Lab., Digital Research Center, Samsung Advanced Institute of Technology (SAIT), Kyunggi, South Korea;Computing Lab., Digital Research Center, Samsung Advanced Institute of Technology (SAIT), Kyunggi, South Korea

  • Venue:
  • PCM'05 Proceedings of the 6th Pacific-Rim conference on Advances in Multimedia Information Processing - Volume Part II
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a novel approach to automatically index digital home photos based on person identity. A person is identified by his/her face and clothes. The proposed method consists of two parts: clustering and indexing. In the clustering, a series of unlabeled photos is aligned in taken-time order, and is divided into several sub-groups by situation. The situation groups are decided by time and visual differences. In the indexing, SVMs are trained with features of pre-indexed faces to model target persons. The representative feature vector of the person group from the clustering is queried to the trained SVMs. Each SVM outputs a numeric confidence value about the query person group. The query person group is determined to the target person by the most confident SVM. The experimental results showed that the proposed method outperformed traditional person indexing method using only face feature and its performance increased to 93.56% from 72.31%.