T2D: Generating Dialogues Between Virtual Agents Automatically from Text

  • Authors:

  • Paul Piwek;Hugo Hernault;Helmut Prendinger;Mitsuru Ishizuka

  • Affiliations:

  • NLG Group, Centre for Research in Computing, The Open University, Walton Hall, Milton Keynes MK7 6AA, UK;National Institute of Informatics, 2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430, Japan;National Institute of Informatics, 2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430, Japan;Graduate School of Information Science and Technology, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan

  • Venue:
  • IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Text2Dialogue (T2D) system that we are developing allows digital content creators to generate attractive multi-modal dialogues presented by two virtual agents--by simply providing textual information as input. We use Rhetorical Structure Theory (RST) to decompose text into segments and to identify rhetorical discourse relations between them. These are then "acted out" by two 3D agents using synthetic speech and appropriate conversational gestures. In this paper, we present version 1.0 of the T2D system and focus on the novel technique that it uses for mapping rhetorical relations to question---answer pairs, thus transforming (monological) text into a form that supports dialogues between virtual agents.