On the detection and recognition of television commercials
ICMCS '97 Proceedings of the 1997 International Conference on Multimedia Computing and Systems
Face recognition: A literature survey
ACM Computing Surveys (CSUR)
Covariance Tracking using Model Update Based on Lie Algebra
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Temporal video structuring for preservation and annotation of video content
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
3rd international workshop on automated information extraction in media production
Proceedings of the international conference on Multimedia
Hi-index | 0.00 |
Semantic queries involving image understanding aspects require the exploitation of multiple clues, namely the (inter-)relations between objects and events across multiple images, the situational context, and the application context. A prominent example for such queries is the identification of individuals in video sequences. Straightforward face recognition approaches require a model of the persons in question and tend to fail in ill conditioned environments. Therefore, an alternative approach is to involve contextual conditions of observations in order to determine the role a person plays in the current context. Due to the strong relation between roles, persons and their identities, knowing either often allows inferring about the other. This paper presents a system that implements this approach: First, robust face detection localizes the actors in the video. By clustering similar face instances the relative frequency of their appearance within a sequence is determined. In combination with a coarse textual annotation manually created by the broadcast station's archivist the roles and consequently the identities can be assigned and labeled in the video. Starting with unambiguous assignments and cascading appropriately most of the persons can be identified and labeled successfully. The feasibility and performance of the role-based person identification is demonstrated on basis of several programs of a popular German TV show, which consists of various elements like interview scenes, games and musical show acts.