A User Experience Model for Home Video Summarization

  • Authors:

  • Wei-Ting Peng;Wei-Jia Huang;Wei-Ta Chu;Chien-Nan Chou;Wen-Yan Chang;Chia-Han Chang;Yi-Ping Hung

  • Affiliations:

  • Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Chung Cheng University, Chiayi, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan;Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan and Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan

  • Venue:
  • MMM '09 Proceedings of the 15th International Multimedia Modeling Conference on Advances in Multimedia Modeling
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

In this paper, we propose a novel system for automatically summarizing home videos based on a user experience model. The user experience model takes account of user's spontaneous behaviors when viewing videos. Based on users' reaction when viewing videos, we can construct a systematic framework to automate video summarization. In this work, we analyze the variations of viewer's eye movement and facial expression when he or she watching the raw home video. We transform these behaviors into the clues of determining the important part of each video shot. With the aids of music analysis, the developed system automatically generates a music video (MV) style summarized home videos. Experiments show that this new type of editing mechanism can effectively generate home video summaries and can largely reduce the efforts of manual summarization.