Aesthetics-based automatic home video skimming system

  • Authors:

  • Wei-Ting Peng;Yueh-Hsuan Chiang;Wei-Ta Chu;Wei-Jia Huang;Wei-Lun Chang;Po-Chung Huang;Yi-Ping Hung

  • Affiliations:

  • Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan and Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan

  • Venue:
  • MMM'08 Proceedings of the 14th international conference on Advances in multimedia modeling
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose an automatic home video skimming system based on media aesthetics. Unlike other similar works, the proposed system considers video editing theory and realizes the idea of computational media aesthetics. Given a home video and a incidental background music, this system generates a music video (MV) style skimming video automatically, with consideration of video quality, music tempo, and the editing theory. The background music is analyzed so that visual rhythm caused by shot changes in the skimming video are synchronous with the music tempo. Our work focuses on the rhythm over aesthetic features, which is more recognizable and more suitable to describe the relationship between video and audio. Experiments show that the generated skimming video is effective in representing the original input video, and the audio-video conformity is satisfactory.