Character identification in feature-length films using global face-name matching
IEEE Transactions on Multimedia
Vlogging: A survey of videoblogging technology on the web
ACM Computing Surveys (CSUR)
Cast2Face: character identification in movie with actor-character correspondence
Proceedings of the international conference on Multimedia
Unsupervised event segmentation of news content with multimodal cues
Proceedings of the 3rd international workshop on Automated information extraction in media production
Audiovisual diarization of people in video content
Multimedia Tools and Applications
| Hi-index | 0.00 |
Major casts, for example, the anchor persons or reporters in news broadcast programs and the principle characters in movies, play an important role in video, and their occurrences provide meaningful indices for organizing and presenting video content. This paper describes a new approach for automatically generating a list of major casts in a video sequence based on multiple modalities, specifically, speaker information in audio track and face information in video track. The core algorithm is composed of three steps. First, speaker boundaries are detected and speaker segments are clustered in audio stream. Second, face appearances are tracked and face tracks are clustered in video stream. Finally, correspondences between speakers and faces are determined based on their temporal co-occurrence. A list of major casts is constructed and ranked in an order that reflects each cast's importance, which is determined by the accumulative temporal and spatial presence of the cast. The proposed algorithm has been integrated in a major cast based video browsing system, which presents the face icon and marks the speech locations in time stream for each detected major cast. The system provides a semantically meaningful summary of the video content, which helps the user to effectively digest the theme of the video