Instant video summarization during shooting with mobile phone

  • Authors:

  • Xiao Zeng;Xiaohui Xie;Kongqiao Wang

  • Affiliations:

  • Beijing University of Posts and Telecommunications and Nokia Research Center, Beijing Economic&Technological Development Area, Beijing, P. R. China;Nokia Research Center, Beijing Economic&Technological Development Area, Beijing, P. R. China;Nokia Research Center, Beijing Economic&Technological Development Area, Beijing, P. R. China

  • Venue:
  • Proceedings of the 1st ACM International Conference on Multimedia Retrieval
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

To facilitate review and management of home videos captured by mobile phones, we propose a novel instant summarization method which is applied while users are shooting. Segment boundaries and key frames are extracted without any delay, which means that the extracted frames strictly synchronize with the scene being captured. Partial-context is the major challenge of this method since only captured frames are available when summarization is applied. And limited calculation resource of mobile phones is another restricted condition in such a video analysis, especially when video compression is executed meanwhile. Several frame features are utilized for segmentation and key frame extraction; and an original key frame updating strategy is presented to optimize selected representative frames in such partial-context. Experimental results demonstrate that the proposed method is satisfactory in the aspects of low computation complexity, high effectiveness and good user experience.