A 'companion' ECA with planning and activity modelling

Authors:
Marc Cavazza;Cameron Smith;Daniel Charlton;Li Zhang;Markku Turunen;Jaakko Hakulinen
Affiliations:
University of Teesside, Middlesbrough, United Kingdom;University of Teesside, Middlesbrough, United Kingdom;University of Teesside, Middlesbrough, United Kingdom;University of Teesside, Middlesbrough, United Kingdom;University of Tampere, Tampere, Finland;University of Tampere, Tampere, Finland
Venue:
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3
Year:
2008

Citing 5
Cited 11

TRIPs: an integrated intelligent problem-solving assistant

AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Automated Planning: Theory & Practice

Automated Planning: Theory & Practice
Conflict negotiation among personal calendar agents

AAMAS '06 Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems
An architecture and applications for speech-based accessibility systems

IBM Systems Journal
PLOW: a collaborative task learning agent

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2

Metaphorical affect sensing in an intelligent conversational agent

ACE '08 Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology
E-Drama: Facilitating Online Role-play using an AI Actor and Emotionally Expressive Characters

International Journal of Artificial Intelligence in Education
Exploration of Affect Sensing from Speech and Metaphorical Text

Edutainment '09 Proceedings of the 4th International Conference on E-Learning and Games: Learning by Playing. Game-based Education System Design and Development
An intelligent agent with affect sensing from metaphorical language and speech

Proceedings of the International Conference on Advances in Computer Enterntainment Technology
Episodic memory for companion dialogue

CDS '10 Proceedings of the 2010 Workshop on Companionable Dialogue Systems
Multimodal and mobile conversational Health and Fitness Companions

Computer Speech and Language
Exploration of metaphorical and contextual affect sensing in a virtual improvisational drama

Transactions on edutainment IV
Towards an episodic memory for companion dialogue

IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Metaphor interpretation and context-based affect detection

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Affect and metaphor sensing in virtual drama

International Journal of Computer Games Technology
A dialogue management system using a corpus-based framework and a dynamic dialogue transition model

AI Communications

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we describe the development of an Embodied Conversational Agent (ECA) implementing the concept of a companion, i.e. an agent supporting the persistent representation of user activities and dialogue-based communication with the user. This first experiment implements a Health and Fitness companion aimed at promoting a healthier lifestyle. The system operates by generating an 'ideal' plan of daily activities from background knowledge and dialogue interaction with the user. This plan then becomes an activity model, which will later be instantiated by reports from the user and analysed by the agent from the perspective of initial objectives. At various stages of the day, the plan can still be adapted through further dialogue. The agent is embodied using a wireless rabbit (Nabaztag™) device situated in the user's home. After describing the planning component, based on Hierarchical Task Networks (HTN) and the spoken dialogue system, we present a working example from the system illustrating its behaviour through various phases of user activity generation, updating and re-planning.