Video summarisation based on the psychological content in the track structure

Authors:
Tsuyoshi Moriyama;Masao Sakauchi
Affiliations:
Institute of Industrial Science, University of Tokyo, 7-22-1 Roppongi, Minato-ku, Tokyo, 106-8558 Japan;Institute of Industrial Science, University of Tokyo, 7-22-1 Roppongi, Minato-ku, Tokyo, 106-8558 Japan
Venue:
MULTIMEDIA '00 Proceedings of the 2000 ACM workshops on Multimedia
Year:
2000

Citing 5
Cited 3

Content-based access to video objects: temporal segmentation, visual summarization, and feature extraction

Signal Processing - Video segmentation for content-based processing manipulation
Determining a Structured Spatio-Temporal Representation of Video Content for Efficient Visualization and Indexing

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Video Skimming and Characterization through the Combination of Image and Language Understanding

CAIVD '98 Proceedings of the 1998 International Workshop on Content-Based Access of Image and Video Databases (CAIVD '98)
Audio as a Support to Scene Change Detection and Characterization of Video Sequences

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 4 - Volume 4
Efficient Access to Video Content in a Unified Framework

ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

Video abstraction techniques for a digital library

Distributed multimedia databases
Extraction of Film Takes for Cinematic Analysis

Multimedia Tools and Applications
Affective video segment retrieval for consumer generated videos based on correlation between emotions and emotional audio events

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this study, the method to summarise TV drama based on the psychological unfolding is proposed. In past researches, video summarisation has been achieved almost by way of choosing representative frames in visual track and never based on the mental side of video content. In this work, the video structure which consists of audio & visual tracks (actor's utterances, BGM, background sound, effect sounds and shots) is modeled and the track-structure-based video summarization method is proposed. To extract the temporal feature patterns of the track structure correspondent with the specific psychological content, each tracks is first quantified by calculating existence ratio etc., and second the intra/inter track feature patterns are determined based on empirical knowledges. The proposed method is implemented and examined in the subjective experiment.