Movie story intensity representation through audiovisual tempo analysis

Authors:
Chia-Hung Yeh;Chih-Hung Kuo;Rung-Wen Liou
Affiliations:
Department of Electrical Engineering, National Sun Yat-Sen University, Kaohsiung, Taiwan (R.O.C.) 80424;Department of Electrical Engineering, National Cheng Kung University, Tainan, Taiwan (R.O.C.) 701;Department of Electrical Engineering, National Cheng Kung University, Tainan, Taiwan (R.O.C.) 701
Venue:
Multimedia Tools and Applications
Year:
2009

Citing 18
Cited 0

Automatic partitioning of full-motion video

Multimedia Systems
Automatic recognition of film genres

Proceedings of the third ACM international conference on Multimedia
Heuristic approach for generic audio data segmentation and annotation

MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Determining computable scenes in films and their structures using audio-visual memory models

MULTIMEDIA '00 Proceedings of the eighth ACM international conference on Multimedia
A utility framework for the automatic generation of audio-visual skims

Proceedings of the tenth ACM international conference on Multimedia
On-line knowledge- and rule-based video classification system for video indexing and dissemination

Information Systems
Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Video Content Analysis Using Multimodal Information: For Movie Content Extraction, Indexing and Representation

Video Content Analysis Using Multimodal Information: For Movie Content Extraction, Indexing and Representation
Automatic Parsing of TV Soccer Programs

ICMCS '95 Proceedings of the International Conference on Multimedia Computing and Systems
Content-based video analysis, indexing and representation using multimodal information

Content-based video analysis, indexing and representation using multimodal information
Multimodal approach to measuring excitement in video

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 1
Video Abstraction Based on Relational Graphs

ICIG '07 Proceedings of the Fourth International Conference on Image and Graphics
A generic framework of user attention model and its application in video summarization

IEEE Transactions on Multimedia
Rapid scene analysis on compressed video

IEEE Transactions on Circuits and Systems for Video Technology
Performance characterization of video-shot-change detection methods

IEEE Transactions on Circuits and Systems for Video Technology
A robust scene-change detection method for video segmentation

IEEE Transactions on Circuits and Systems for Video Technology
Factor graph framework for semantic video indexing

IEEE Transactions on Circuits and Systems for Video Technology
Video summarization and scene detection by graph modeling

IEEE Transactions on Circuits and Systems for Video Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

A comprehensive method for movie abstraction is developed in this research for applications in fast movie content exploring, indexing, browsing, and skimming, Most current approaches rely heavily on specific domain knowledge or models to identify and extract the determining scenes of a given movie; however, the segments extracted are often isolated, presenting a fragmented outline of the original. Our proposed method fuses simple audiovisual features, and measures the "tempos" of a movie directly, especially that of long-term ones. These tempos form a curve that catches the high-level semantics of a movie, indicating the events of interests named as "story intensity." Through tempo, the proposed algorithm provides a natural way that segments a movie into manageable parts. As our experimental results demonstrate, the condensed skimming clips efficiently extract semantic content that contains the most interesting and informative parts of the original movie.