Video-based toon character from surface performance capture

  • Authors:
  • Yann Savoye

  • Affiliations:
  • INRIA Bordeaux University, France

  • Venue:
  • SIGGRAPH Asia 2011 Sketches
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recent advances in dynamic surface capture have made the creation of a realistic animation a promising task for modern visual media production such as computer generated movies or 3D cinematographic video games. Nonetheless, automatic creation of cartoon mesh animations, driven by real-life cues, is still a costly and time-consuming process and presents a number of hard technical challenges. To the best of our knowledge, we propose the first attempt at generating as-photorealistic-as possible cartoon animation from markerless surface performance capture. The purpose of synthesizing new puppetry animation demonstrating fidelity to the spirit of comic book style with more exaggerated motion while preserving extreme captured cloth wrinkles is difficult to achieve. Consequently, the key contribution of our work focuses on a novel cartoon stylization approach for 3D video that efficiently reuse temporally consistent dynamic surface sequence captured from real-world actor performance. In particular, our simple and effective algorithm converts realistic spatiotemporal captured surfaces and multi-view data into an exaggerated life-like squash-and-stretch shape evolution coupled with context-aware cartoon-style expressive rendering.