Dynamic social network for narrative video analysis

Authors:
Tsung-Hung Tsai;Wen-Huang Cheng;Yung-Huan Hsieh
Affiliations:
Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan Roc;Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan Roc;Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan Roc
Venue:
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Year:
2011

Citing 11
Cited 0

Sliding-window filtering: an efficient algorithm for incremental mining

Proceedings of the tenth international conference on Information and knowledge management
Action movies segmentation and summarization based on tempo analysis

Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval
Temporal event clustering for digital photo collections

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Sequential association mining for video summarization

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03) - Volume 03
Representing and playing user selected video narrative domains

SRMC '08 Proceedings of the 2nd ACM international workshop on Story representation, mechanism and context
RoleNet: movie analysis from the perspective of social networks

IEEE Transactions on Multimedia - Special issue on integration of context and content
A novel video summarization based on mining the story-structure and semantic relations among concept entities

IEEE Transactions on Multimedia - Special issue on integration of context and content
Character identification in feature-length films using global face-name matching

IEEE Transactions on Multimedia
Cast2Face: character identification in movie with actor-character correspondence

Proceedings of the international conference on Multimedia
Automatic trailer generation

Proceedings of the international conference on Multimedia
Film narrative exploration through the analysis of aesthetic elements

MMM'07 Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

Narrative video analysis has attracted much research attention, for narrative scenes can provide meaningful representations of multimedia contents. To go beyond the limitations of content based appraoches, social network techniques was introduced in the literature to explore the high-level narrative structures by mining the relations between video characters. Taking into account the fact that such a social network is not static but changes over time as the video narrative evolves, in this work, we develop a novel social network model, namely dynamic social network, for capturing the spatiotemporal dynamics in the social network of video characters so as to enable the automatic segmentation of a video into a sequence of narrative scenes. The proposed approach is experimented with various genres of movies and the results demonstrate our effectiveness.