Affect as Information about Users' Attitudes to Conversational Agents

  • Authors:
  • Michal Ptaszynski;Pawel Dybala;Shinsuke Higuchi;Rafal Rzepka;Kenji Araki

  • Affiliations:
  • -;-;-;-;-

  • Venue:
  • WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 03
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a novel method for automatic evaluation of conversational agents. In the method, information about users’ attitudes and sentiments to conversational agents and their performance are achieved by analyzing their general emotional engagement in the conversation and specific affective states, and interpreting them using psychological reasoning of Affect-as-Information. In the evaluation experiment the users’ attitudes to two Japanese-speaking conversational agents were checked simultaneously in a survey and using a system constructed on the proposed method. The results returned by the system revealed similar tendencies as the survey. Therefore the method is applicable as a mean of evaluation for Japanese-speaking conversational agents.