The robust estimation of multiple motions: parametric and piecewise-smooth flow fields
Computer Vision and Image Understanding
Auto-summarization of audio-video presentations
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Exploring Video Structure Beyond The Shots
ICMCS '98 Proceedings of the IEEE International Conference on Multimedia Computing and Systems
Video Snapshot: A Bird View of Video Sequence
MMM '05 Proceedings of the 11th International Multimedia Modelling Conference
Proceedings of the 14th IEEE Visualization 2003 (VIS'03)
ACM SIGGRAPH 2006 Papers
Schematic storyboarding for video visualization and editing
ACM SIGGRAPH 2006 Papers
Visual attention detection in video sequences using spatiotemporal cues
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Video summarisation: A conceptual framework and survey of the state of the art
Journal of Visual Communication and Image Representation
Extracting story units from long programs for video browsing and navigation
ICMCS '96 Proceedings of the 1996 International Conference on Multimedia Computing and Systems
Sketch2Photo: internet image montage
ACM SIGGRAPH Asia 2009 papers
RepFinder: finding approximately repeated scene elements for image editing
ACM SIGGRAPH 2010 papers
ACM SIGGRAPH 2010 papers
Video tapestries with continuous temporal zoom
ACM SIGGRAPH 2010 papers
Interactive motion photography from a single image
The Visual Computer: International Journal of Computer Graphics
Environment-Sensitive cloning in images
The Visual Computer: International Journal of Computer Graphics - CGI'2011 Conference
Candid portrait selection from video
Proceedings of the 2011 SIGGRAPH Asia Conference
Arcimboldo-like collage using internet images
Proceedings of the 2011 SIGGRAPH Asia Conference
Global contrast based salient region detection
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Video visualization for compact presentation and fast browsing of pictorial content
IEEE Transactions on Circuits and Systems for Video Technology
Video summarization and scene detection by graph modeling
IEEE Transactions on Circuits and Systems for Video Technology
Editorial: Foreword to special section
Computers and Graphics
Hierarchical Narrative Collage For Digital Photo Album
Computer Graphics Forum
Hi-index | 0.00 |
This paper presents a video summarization approach that automatically extracts and visualizes movie storylines in a static image for the purposes of efficient representation and quick overview. A new type of video visualization, Visual Storylines, is designed to summarize video storylines in an image composition while preserving the style of the original videos. This is achieved with a series of video analysis, image synthesis, relationship quantification and geometric layout optimization techniques. Specifically, we analyze the video contents and quantify the video story unit relationships automatically through clustering video shots according to both the visual and audio data. A multi-level storyline visualization method then organizes and synthesizes a suitable amount of representative information, including both the locations and interested objects and characters, with the assistance of arrows, according to the relationships between the video story units and the temporal structure of the video sequence. Several results have demonstrated that our approach is able to abstract the main storylines of professionally edited video such as commercial movies and TV series, though some semantic key clues might be missed in the summarization. Preliminary user studies have been performed to evaluate our approach, and the results show that our approach can be used to assist viewers to understand video contents when they are familiar with the context of the video or when a text synopsis is provided.