Identification of narrative peaks in video clips: text features perform best

Authors:
Joep J. M. Kierkels;Mohammad Soleymani;Thierry Pun
Affiliations:
Department of medical physics, TweeSteden hospital, Tilburg, The Netherlands and Computer vision and multimedia laboratory, Computer Science Department, University of Geneva, Geneva, Switzerland;Computer vision and multimedia laboratory, Computer Science Department, University of Geneva, Geneva, Switzerland;Computer vision and multimedia laboratory, Computer Science Department, University of Geneva, Geneva, Switzerland
Venue:
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Year:
2009

Citing 8
Cited 1

Measuring the effect of fundamental frequency raising as a strategy for increasing vocal intensity in soft, normal and loud phonation

Speech Communication
How to distinguish posed from spontaneous smiles using geometric features

Proceedings of the 9th international conference on Multimodal interfaces
Using film cutting techniques in interface design

Human-Computer Interaction
Affective Characterization of Movie Scenes Based on Multimedia Content Analysis and User's Physiological Emotional Responses

ISM '08 Proceedings of the 2008 Tenth IEEE International Symposium on Multimedia
Dynamic video summarization using two-level redundancy detection

Multimedia Tools and Applications
Overview of VideoCLEF 2009: new perspectives on speech-based multimedia content enrichment

CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Adaptive extraction of highlights from a sport video based on excitement modeling

IEEE Transactions on Multimedia
A highlight scene detection and video summarization system using audio feature for a personal video recorder

IEEE Transactions on Consumer Electronics

Overview of VideoCLEF 2009: new perspectives on speech-based multimedia content enrichment

CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments

Quantified Score

Hi-index	0.00

Visualization

Abstract

A methodology is proposed to identify narrative peaks in video clips. Three basic clip properties are evaluated which reflect on video, audio and text related features in the clip. Furthermore, the expected distribution of narrative peaks throughout the clip is determined and exploited for future predictions. Results show that only the text related feature, related to the usage of distinct words throughout the clip, and the expected peak-distribution are of use when finding the peaks. On the training set, our best detector had an accuracy of 47% in finding narrative peaks. On the test set, this accuracy dropped to 24%.