Joint activity theory as a framework for natural body expression in autonomous agents

  • Authors:
  • Divesh Lala;Toyoaki Nishida

  • Affiliations:
  • Kyoto University;Kyoto University

  • Venue:
  • Proceedings of the 1st International Workshop on Multimodal Learning Analytics
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Creating agents which utilize natural verbal and non-verbal communication is an appropriate goal for many researchers involved in human-computer interaction. Using these types of agents enhances their capabilities as a communication tool for teaching humans inside a virtual environment. This paper describes how Herbert Clark's theory of joint activities can be applied to agents, extending it to a domain in which communication is weighted towards the non-verbal, specifically body expressions. The major framework for this implementation is the joint action ladder, in which a communicative act is checked at several levels before it can be understood and responded to by the receiver of the act. A proposed environment has been created in the form of a basketball game, where a user can interact with his team through natural body movements. Through this type of interaction, the user has the potential to learn gestural expressions through observation as well as less explicit concepts such as the internal state of agents. Several avenues of research that can be followed through the use of the basketball game are also described.