A conversational agent as museum guide: design and evaluation of a real-world application
Lecture Notes in Computer Science
From brows to trust: evaluating embodied conversational agents
From brows to trust: evaluating embodied conversational agents
Evaluation of multimodal behaviour of embodied agents
From brows to trust
ECA as user interface paradigm
From brows to trust
Interaction Design: Beyond Human Computer Interaction
Interaction Design: Beyond Human Computer Interaction
Validating the web-based evaluation of NLG systems
ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
Gaze, conversational agents and face-to-face communication
Speech Communication
Hi-index | 0.00 |
A new experimental method based on the dual task paradigm is used to evaluate speech intelligibility of an embodied conversational agent (ECA). The experiment consists of the manipulation of auditory-visual (AV) versus auditory-only (A) presentation of speech. In the dual task, participants perform two tasks concurrently. The secondary task is sensitive to cognitive processing demands of the primary task. In the primary task participants either shadowed words or named the superordinate categories to which words belonged, as the word items were spoken by the ECA under A or AV conditions. Reaction time (RT) on the secondary task-swatting a fly on the ECA face-was affected by the difficulty of the concurrent task. The secondary RT was affected by modality of presentation of the primary task. Using a relatively primitive ECA, RT on the secondary task was significantly slower when shadowing occurred in AV versus A conditions. The benefits of this evaluation system, that returns quantitative behavioural data and self-report ratings, are discussed.