Determining computable scenes in films and their structures using audio-visual memory models
MULTIMEDIA '00 Proceedings of the eighth ACM international conference on Multimedia
Multi-Modal Dialog Scene Detection Using Hidden Markov Models for Content-Based Multimedia Indexing
Multimedia Tools and Applications
Movie Event Detection by Using Audio Visual Information
PCM '01 Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Constructing table-of-content for videos
Multimedia Systems - Special section on video libraries
Video Scene Segmentation via Continuous Video Coherence
CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Time-Constrained Clustering for Segmentation of Video into Story Unites
ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Video Content Analysis Using Multimodal Information: For Movie Content Extraction, Indexing and Representation
Introduction to MPEG-7: Multimedia Content Description Interface
Introduction to MPEG-7: Multimedia Content Description Interface
Scene Determination Based on Video and Audio Features
ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
Audio-assisted scene segmentation for story browsing
CIVR'03 Proceedings of the 2nd international conference on Image and video retrieval
Dialogue sequence detection in movies
CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
A system for event-based film browsing
TIDSE'06 Proceedings of the Third international conference on Technologies for Interactive Digital Storytelling and Entertainment
Video visualization for compact presentation and fast browsing of pictorial content
IEEE Transactions on Circuits and Systems for Video Technology
On parsing visual sequences with the hidden Markov model
Journal on Image and Video Processing
Hierarchical modeling and adaptive clustering for real-time summarization of rush videos
IEEE Transactions on Multimedia
Crowdsourcing the indexing of film and television media
Proceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem - Volume 47
Use of content analysis tools for visual interaction design
IVIC'11 Proceedings of the Second international conference on Visual informatics: sustaining research and innovations - Volume Part II
Mining movies to extract song sequences
Proceedings of the Eleventh International Workshop on Multimedia Data Mining
Mining movies for song sequences with video based music genre identification system
Information Processing and Management: an International Journal
Mining movie archives for song sequences
Multimedia Tools and Applications
Hi-index | 0.00 |
This paper presents an approach to movie video indexing that utilises audiovisual analysis to detect important and meaningful temporal video segments, that we term events. We consider three event classes, corresponding to dialogues, action sequences, and montages, where the latter also includes musical sequences. These three event classes are intuitive for a viewer to understand and recognise whilst accounting for over 90% of the content of most movies. To detect events we leverage traditional filmmaking principles and map these to a set of computable low-level audiovisual features. Finite state machines (FSMs) are used to detect when temporal sequences of specific features occur. A set of heuristics, again inspired by filmmaking conventions, are then applied to the output of multiple FSMs to detect the required events. A movie search system, named MovieBrowser, built upon this approach is also described. The overall approach is evaluated against a ground truth of over twenty-three hours of movie content drawn from various genres and consistently obtains high precision and recall for all event classes. A user experiment designed to evaluate the usefulness of an event-based structure for both searching and browsing movie archives is also described and the results indicate the usefulness of the proposed approach.