Speech recognition by machines and humans
Speech Communication
Affective computing
Gandalf: an embodied humanoid capable of real-time multimodal dialogue with people
AGENTS '97 Proceedings of the first international conference on Autonomous agents
Developing and evaluating conversational agents
Embodied conversational agents
Measurement and evaluation of embodied conversational agents
Embodied conversational agents
Emotional meaning and expression in animated faces
Affective interactions
Spoken dialogue technology: enabling the conversational user interface
ACM Computing Surveys (CSUR)
Handbook of Multimodal and Spoken Dialogue Systems: Resources, Terminology and Product Evaluation
Handbook of Multimodal and Spoken Dialogue Systems: Resources, Terminology and Product Evaluation
Visual Prosody: Facial Movements Accompanying Speech
FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Towards developing general models of usability with PARADISE
Natural Language Engineering
DATE: a dialogue act tagging scheme for evaluation of spoken dialogue systems
HLT '01 Proceedings of the first international conference on Human language technology research
| Hi-index | 0.00 |
An increasing number of dialogue systems are deployed to provide public services in our everyday lives. They are becoming more service-minded and several of them provide different channels for interaction. The rationale is to make automatic services available in new environments and more attractive to use. From a developer perspective, this affects the complexity of the requirements elicitation activity, as new combinations and variations in end-user interaction need to be considered. The aim of our investigation is to propose new parameters and metrics to evaluate multimodal dialogue systems endowed with embodied conversational agents (ECAs). These new matrics focus on the users, rather than on the system. Our assumption is that the intentional use of prosodic variation and the production of communicative nonverbal behaviour by users can give an indication of their attitude towards the system and might also help to evaluate the users' overall experience of the interaction. To test our hypothesis we carried out analyses on different Swedish corpora of interactions between users and multimodal dialogue systems. We analysed the prosodic variation in the way the users ended their interactions with the system and we observed the prodution of non-verbal communicative expressions by users. Our study supports the idea that the observation of users' prosodic variation and production of communicative non-verbal behaviour during the interaction with dialogue syslems could be used as an indication of whether or not the users are satisfied with the system performance.