Recreation of spontaneous non-verbal behavior on a synthetic agent EVA

  • Authors:
  • Izidor Mlakar;Matej Rojc

  • Affiliations:
  • Roboti c.s. d.o.o, University of Maribor, Slovenia;Faculty of Electrical Engineering and Computer Science, University of Maribor, Slovenia

  • Venue:
  • AIKED'12 Proceedings of the 11th WSEAS international conference on Artificial Intelligence, Knowledge Engineering and Data Bases
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a novel process of transferring the human-generated communicative behavior onto an embodied conversational agent. The aim of our work is to build a high-resolution motion dictionary based on empirical analysis of non-verbal behavior performed in multi-speaker informal dialogues. The verbal and non-verbal behavior is recreated by using this motion dictionary and on pure, unprocessed text. It involves animating hand and arm gestures, head movement and gaze, and facial expressions with lip-sync. The generated non-verbal behavior is speech driven and in synchrony with verbal information passed in form of synthetically generated speech.