Online Video Stream Abstraction and Stylization

  • Authors:
  • Song-Hai Zhang;Xian-Ying Li;Shi-Min Hu;Ralph R. Martin

  • Affiliations:
  • National Laboratory for Information Science and Technology, the Department of Computer Science and Technology, Tsinghua University, Beijing, China;National Laboratory for Information Science and Technology, the Department of Computer Science and Technology, Tsinghua University, Beijing, China;National Laboratory for Information Science and Technology, the Department of Computer Science and Technology, Tsinghua University, Beijing, China;School of Computer Science & Informatics, Cardiff University, Cardiff, UK

  • Venue:
  • IEEE Transactions on Multimedia
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper gives an automatic method for online video stream abstraction, producing a temporally coherent output video stream, in a style with large regions of constant color and highlighted bold edges. Our system includes two novel components. Firstly, to provide coherent and simplified output, we segment frames, and use optical flow to propagate segmentation information from frame to frame; an error control strategy is used to help ensure that the propagated information is reliable. Secondly, to achieve coherent and attractive coloring of the output, we use a color scheme replacement algorithm specifically designed for an online video stream. We demonstrate real-time performance for CIF videos, allowing our approach to be used for live communication and other related applications.