Creativity meets automation: combining nonverbal action authoring with rules and machine learning

  • Authors:
  • Michael Kipp

  • Affiliations:
  • DFKI, Saarbrücken, Germany

  • Venue:
  • IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Providing virtual characters with natural gestures is a complex task. Even if the range of gestures is limited, deciding when to play which gesture may be considered both an engineering or an artistic task. We want to strike a balance by presenting a system where gesture selection and timing can be human authored in a script, leaving full artistic freedom to the author. However, to make authoring faster we offer a rule system that generates gestures on the basis of human authored rules. To push automation further, we show how machine learning can be utilized to suggest further rules on the basis of previously annotated scripts. Our system thus offers different degrees of automation for the author, allowing for creativity and automation to join forces.