Designing Socially Aware Conversational Agents

Authors:
Koen Turnhout;Jacques Terken;Berry Eggen
Affiliations:
Faculteit Industrial Design, Technische Universiteit Eindhoven, Eindhoven, The Netherlands 5600 MB;Faculteit Industrial Design, Technische Universiteit Eindhoven, Eindhoven, The Netherlands 5600 MB;Faculteit Industrial Design, Technische Universiteit Eindhoven, Eindhoven, The Netherlands 5600 MB
Venue:
PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
Year:
2008

Citing 7
Cited 1

Designing the user interface (2nd ed.): strategies for effective human-computer interaction

Designing the user interface (2nd ed.): strategies for effective human-computer interaction
Heuristic evaluation

Usability inspection methods
Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Video cut editing rule based on participants' gaze in multiparty conversation

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Identifying the addressee in human-human-robot interactions based on head pose and speech

Proceedings of the 6th international conference on Multimodal interfaces
Identifying the intended addressee in mixed human-human and human-computer interaction from non-verbal features

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Multimodalcues for addressee-hood in triadic communication with a human information retrieval agent

Proceedings of the 9th international conference on Multimodal interfaces

Joint activity theory as a framework for natural body expression in autonomous agents

Proceedings of the 1st International Workshop on Multimodal Learning Analytics

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we address the problem of how to make conversational agents socially aware. State-of-the-art conversational agents cannot deal with multi-user situations where the user-system dialog is interleaved with discussions between users. We describe the development of an algorithm for determining addressee-hood of user utterances. The algorithm makes errors in determining addressee-hood for individual utterances, classifying utterances intended for the system as utterances intended for the other user and the other way around, creating unexpected situations in the agent's behaviour. This raises the question of how to design the conversational agent so that the users understand why the agent behaves in particular ways. We describe a study aimed at obtaining guidelines for the design of a socially aware conversational agent. We conclude that principles for modelling the behaviour of the agent are to be derived from theories about human communication rather than from theories about human-computer interaction.