Learning backchannel prediction model from parasocial consensus sampling: a subjective evaluation

  • Authors:

  • Lixing Huang;Louis-Philippe Morency;Jonathan Gratch

  • Affiliations:

  • Institute for Creative Technologies, University of Southern California, Marina del Rey, CA;Institute for Creative Technologies, University of Southern California, Marina del Rey, CA;Institute for Creative Technologies, University of Southern California, Marina del Rey, CA

  • Venue:
  • IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Backchannel feedback is an important kind of nonverbal feedback within face-to-face interaction that signals a person's interest, attention and willingness to keep listening. Learning to predict when to give such feedback is one of the keys to creating natural and realistic virtual humans. Prediction models are traditionally learned from large corpora of annotated face-to-face interactions, but this approach has several limitations. Previously, we proposed a novel data collection method, Parasocial Consensus Sampling, which addresses these limitations. In this paper, we show that data collected in this manner can produce effective learned models. A subjective evaluation shows that the virtual human driven by the resulting probabilistic model significantly outperforms a previously published rule-based agent in terms of rapport, perceived accuracy and naturalness, and it is even better than the virtual human driven by real listeners' behavior in some cases.