Modeling Textured Motion: Particle, Wave and Sketch

  • Authors:
  • Yizhou Wang;Song-Chun Zhu

  • Affiliations:
  • -;-

  • Venue:
  • ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a generative model for textured motionphenomena, such as falling snow, wavy river and dancing grass, etc.Firstly, we represent an image as a linear superposition of imagebases selected from a generic and over-complete dictionary. Thedictionary contains Gabor bases for point/particle elements andFourier bases for wave-elements. These bases compete to explain theinput images. The transform from a raw image to a base or a tokenrepresentation leads to large dimension reduction. Secondly, weintroduce a unified motion equation to characterize the motion ofthese bases and the interactions between waves and particles, e.g.a ball floating on water. We use statistical learning algorithm toidentify the structure of moving objects and their trajectoriesautomatically. Then novel sequences can be synthesized easily fromthe motion and image models. Thirdly, we replace the dictionary ofGabor and Fourier bases with symbolic sketches (also bases). Withthe same image and motion model, we can render realistic andstylish cartoon animation. In our view, cartoon and sketch aresymbolic visualization of the inner representation for visualperception. The success of the cartoon animation, in turn, suggeststhat our image and motion models capture the essence of visualperception of textured motion.