Rushes video summarization using audio-visual information and sequence alignment

Authors:
Yang Liu;Yan Liu;Tongwei Ren;Keith C.C. Chan
Affiliations:
The Hong Kong Polytechnic University, Hong Kong, Hong Kong;The Hong Kong Polytechnic University, Hong Kong, Hong Kong;The Hong Kong Polytechnic University, Kowloon, Hong Kong and Nanjing University, Nanjing, China;The Hong Kong Polytechnic University, Hong Kong, Hong Kong
Venue:
TVS '08 Proceedings of the 2nd ACM TRECVid Video Summarization Workshop
Year:
2008

Citing 6
Cited 1

Automatic partitioning of full-motion video

Multimedia Systems
The Hong Kong Polytechnic University at TRECVID 2007 BBC rushes summarization

Proceedings of the international workshop on TRECVID video summarization
The trecvid 2008 BBC rushes summarization evaluation

TVS '08 Proceedings of the 2nd ACM TRECVid Video Summarization Workshop
Summarization of Visual Content in Instructional Videos

IEEE Transactions on Multimedia
Automatic soccer video analysis and summarization

IEEE Transactions on Image Processing
Color and texture descriptors

IEEE Transactions on Circuits and Systems for Video Technology

The trecvid 2008 BBC rushes summarization evaluation

TVS '08 Proceedings of the 2nd ACM TRECVid Video Summarization Workshop

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes our system and methodologies for the BBC rushes video summarization task of TRECVID 2008. The procedure of the system is composed of three major steps: shot detection, irrelevant and repetitive subshot removal, and final summary generation. First, we segment the original rushes video into subshots according to the difference and accumulative difference of local color histogram between consecutive frames. Second, we recognize the irrelevant subshots, such as subshots of color bar, pure gray frames, and clapper board. We propose a novel video sequence alignment algorithm to detect repetitive subshots. After removing the irrelevant and repetitive subshots, we generate the final summary using the remaining informative and representative subshots. The evaluation from TRECVID 2008 shows that our system can generate good video summaries.