A Model of Saliency-Based Visual Attention for Rapid Scene Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Video Manga: generating semantically meaningful video summaries
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
ACM Computing Surveys (CSUR)
Rapid serial visual presentation: a space-time trade-off in information presentation
AVI '00 Proceedings of the working conference on Advanced visual interfaces
Content-Based Image Retrieval at the End of the Early Years
IEEE Transactions on Pattern Analysis and Machine Intelligence
Combinatorial Algorithms: For Computers and Hard Calculators
Combinatorial Algorithms: For Computers and Hard Calculators
Normalized Cuts and Image Segmentation
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Rapid, serial and visual: a presentation technique with potential
Information Visualization
Dynamic key frame presentation techniques for augmenting video browsing
AVI '98 Proceedings of the working conference on Advanced visual interfaces
A fast layout algorithm for visual video summaries
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 1
Rapid scene analysis on compressed video
IEEE Transactions on Circuits and Systems for Video Technology
Efficient Layout of Comic-Like Video Summaries
IEEE Transactions on Circuits and Systems for Video Technology
Fast analysis of scalable video for adaptive browsing interfaces
Computer Vision and Image Understanding
Effective comic-like representations with embedded regions of interest
PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
| Hi-index | 0.00 |
This paper presents a system for compact and intuitive video summarisation aimed at both high-end professional production environments and small-screen portable devices. To represent large amounts of information in the form of a video key-frame summary, this paper studies the narrative grammar of comics, and using its universal and intuitive rules, lays out visual summaries in an efficient and user-centered way. In addition, the system exploits visual attention modelling and rapid serial visual presentation to generate highly compact summaries on mobile devices. A robust real-time algorithm for key-frame extraction is presented. The system ranks importance of key-frame sizes in the final layout by balancing the dominant visual representability and discovery of unanticipated content utilising a specific cost function and an unsupervised robust spectral clustering technique. A final layout is created using an optimisation algorithm based on dynamic programming. Algorithm efficiency and robustness are demonstrated by comparing the results with a manually labelled ground truth and with optimal panelling solutions.