Semantic video indexing and summarization using subtitles

Authors:
Haoran Yi;Deepu Rajan;Liang-Tien Chia
Affiliations:
Center for Multimedia and Network Technology, School of Computer Engineering, Nanyang Technological University, Singapore;Center for Multimedia and Network Technology, School of Computer Engineering, Nanyang Technological University, Singapore;Center for Multimedia and Network Technology, School of Computer Engineering, Nanyang Technological University, Singapore
Venue:
PCM'04 Proceedings of the 5th Pacific Rim conference on Advances in Multimedia Information Processing - Volume Part I
Year:
2004

Citing 3
Cited 3

Content-Based Video Indexing and Retrieval

IEEE MultiMedia
Using linear algebra for intelligent information retrieval

SIAM Review
Matrices, Vector Spaces, and Information Retrieval

SIAM Review

Evaluation of video news classification techniques for automatic content personalisation

International Journal of Advanced Media and Communication
Video news classification for automatic content personalization: a genetic algorithm based approach

Proceedings of the 14th Brazilian Symposium on Multimedia and the Web
Automatic visualization of story clusters in TV series summary

MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling

Quantified Score

Hi-index	0.00

Visualization

Abstract

How to build semantic index for multimedia data is an important and challenging problem for multimedia information systems. In this paper, we present a novel approach to build a semantic video index for digital videos by analyzing the subtitle files of DVD/DivX videos. The proposed approach for building semantic video index consists of 3 stages, viz., script extraction, script partition and script vector representation. First, the scripts are extracted from the subtitle files that are available in the DVD/DivX videos. Then, the extracted scripts are partitioned into segments. Finally, the partitioned script segments are converted into a tfidf vector based representation, which acts as the semantic index. The efficiency of the semantic index is demonstrated through video retrieval and summarization applications. Experimental results demonstrate that the proposed approach is very promising.