A generic virtual content insertion system based on visual attention analysis

  • Authors:

  • Huiying Liu;Shuqiang Jiang;Qingming Huang;Changsheng Xu

  • Affiliations:

  • Chinese Academy of Sciences and China-Singapore Institute of Digital Media, Beijing, China;Chinese Academy of Sciences, Beijing, China;Graduate University of Chinese Academy of Sciences and China-Singapore Institute of Digital Media, Beijing, China;China-Singapore Institute of Digital Media and Chinese Academy of Sciences, Beijing, China

  • Venue:
  • MM '08 Proceedings of the 16th ACM international conference on Multimedia
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a generic Virtual Content Insertion (VCI) system based on visual attention analysis. VCI is an emerging application of video analysis and has been used in video augmentation and advertisement insertion. There are three critical issues for a VCI system: when (time), where (place) and how (method) to insert the Virtual Content (VC) into the video. Our system selects the insertion time and place by performing temporal and spatial attention analysis, which predicts the attention change along time and the attended region over space. In order to enable the inserted VC to be noticed by audience while not to interrupt the audience's viewing experience to the original content, the VC should be inserted at the time when the video content attracts much audience attention and at the place where attracts less. Dynamic insertion is performed by using Global Motion Estimation (GME) and affine transformation. Our VCI system is able to obtain an optimal balance between the notice of the VC by audience and disruption of viewing experience to the original content. Extensive subjective evaluations based on user study on the VCI result have verified the effectiveness of the system.