Building of turn-taking avatars that express utterance attitudes: a social scientific approach to behavioral design of conversational agents

  • Authors:
  • Masahide Yuasa;Naoki Mukawa

  • Affiliations:
  • School of Information Environment, Tokyo Denki University, Muzai Gakuendai, Inzai, Chiba, Japan;School of Information Environment, Tokyo Denki University, Muzai Gakuendai, Inzai, Chiba, Japan

  • Venue:
  • UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: applications and services - Volume Part IV
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In everyday communication, humans comprehend the attitudes of others conveyed via nonverbal behavior, such as facial expression, body posture and gaze behavior. In this paper, we describe a model for comprehending participants' desire to start to speak or to listen based on nonverbal behavior during conversation. We use a social scientific approach that is based on both an analysis of a video observation and an experiment using avatars. We explain the building of the model. We discuss detecting participant's attitudes using computer vision and the expression of their attitudes using their avatars' facial expressions and body postures.