What Does the Face-Turning Action Imply in Consensus Building Communication?

  • Authors:
  • Tetsuro Onishi;Takatsugu Hirayama;Takashi Matsuyama

  • Affiliations:
  • Graduate School of Informatics, Kyoto University, Sakyo-ku, Japan;Graduate School of Informatics, Kyoto University, Sakyo-ku, Japan;Graduate School of Informatics, Kyoto University, Sakyo-ku, Japan

  • Venue:
  • MLMI '08 Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

When talking with someone, we convey intention to each other by verbal and non-verbal behaviors. In consensus building dialogue, the participants need to understand whether they agree or disagree. They reiterate confirmation of partner's internal state (agreement/disagreement) and reaction for it. In this study, we considered that the timing of listener's reaction for the confirmation by a speaker reflects listener's internal state, therefore analyzed the multimodal timing structures between the confirmation and the reaction by utterance and body motion. Especially, we focused on an action that the speaker turns his face toward the listener as the confirming action and analyzed how it influences the timing structures. As the results, we confirmed that the timing structures relate to the internal state and the relations are controlled by face-turningaction.