Incremental dialogue understanding and feedback for multiparty, multimodal conversation

  • Authors:
  • David Traum;David DeVault;Jina Lee;Zhiyang Wang;Stacy Marsella

  • Affiliations:
  • Institute for Creative Technologies, University of Southern California, Playa Vista, CA;Institute for Creative Technologies, University of Southern California, Playa Vista, CA;Institute for Creative Technologies, University of Southern California, Playa Vista, CA;Institute for Creative Technologies, University of Southern California, Playa Vista, CA;Institute for Creative Technologies, University of Southern California, Playa Vista, CA

  • Venue:
  • IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In order to provide comprehensive listening behavior, virtual humans engaged in dialogue need to incrementally listen, interpret, understand, and react to what someone is saying, in real time, as they are saying it. In this paper, we describe an implemented system for engaging in multiparty dialogue, including incremental understanding and a range of feedback. We present an FML message extension for feedback in multipary dialogue that can be connected to a feedback realizer. We also describe how the important aspects of that message are calculated by different modules involved in partial input processing as a speaker is talking in a multiparty dialogue.