Attention-based video summarisation in rushes collection

Authors:
Reede Ren;Punitha Puttu Swamy;Joemon M. Jose;Jana Urban
Affiliations:
Glasgow University, Glasgow, United Kngdm;Glasgow University, Glasgow, United Kngdm;Glasgow University, Glasgow, United Kngdm;Glasgow University, Glasgow, United Kngdm
Venue:
Proceedings of the international workshop on TRECVID video summarization
Year:
2007

Citing 9
Cited 2

Time-compression: systems concerns, usage, and benefits

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Dynamic video summarization and visualization

MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 2)
A utility framework for the automatic generation of audio-visual skims

Proceedings of the tenth ACM international conference on Multimedia
A user attention model for video summarization

Proceedings of the tenth ACM international conference on Multimedia
Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Automatic replay generation for soccer video broadcasting

Proceedings of the 12th annual ACM international conference on Multimedia
The trecvid 2007 BBC rushes summarization evaluation pilot

Proceedings of the international workshop on TRECVID video summarization
Optimization-based automated home video editing system

IEEE Transactions on Circuits and Systems for Video Technology
Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains

IEEE Transactions on Circuits and Systems for Video Technology

Video redundancy detection in rushes collection

TVS '08 Proceedings of the 2nd ACM TRECVid Video Summarization Workshop
Semantic based adaptive movie summarisation

MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the framework of a general video summarisation system on the rushes collection, which formalises the summarisation process as an 0-1 Knapsack optimisation problem. Three stages are included, namely content analysis, content selection and summary composition. Content analysis is the pre-processing step, consisting of shot segmentation, feature extraction, raw video discrimination and shot clustering. Content selection weights the importance of video segments by an attention model. A greedy approximation approach is employed in the composition of summary video with the cost function, which balances the video importance gain and the duration cost. The average content coverage achieved on the rushes test collection is about 29%, while the average qualification score on readability is 3.13 with the redundancy credit at 4.08.