Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment

Authors:
Rutger Rienks;Ronald Poppe;Dirk Heylen
Affiliations:
University of Twente, Enschede, The Netherlands;University of Twente, Enschede, The Netherlands;University of Twente, Enschede, The Netherlands
Venue:
ACM Transactions on Applied Perception (TAP)
Year:
2010

Citing 9
Cited 2

Speech patterns in video-mediated conversations

CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The impact of eye gaze on communication using humanoid avatars

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Why conversational agents should catch the eye

CHI '00 Extended Abstracts on Human Factors in Computing Systems
Tracking Focus of Attention in Meetings

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Structural Encoding of Human and Schematic Faces: Holistic and Part-Based Processes

Journal of Cognitive Neuroscience
Eye communication in a conversational 3D synthetic agent

AI Communications
Transformed Social Interaction: Decoupling Representation from Behavior and Form in Collaborative Virtual Environments

Presence: Teleoperators and Virtual Environments
Virtual meeting rooms: from observation to simulation

AI & Society

Multimodal end-of-turn prediction in multi-party meetings

Proceedings of the 2009 international conference on Multimodal interfaces
Voice activity detection from gaze in video mediated communication

Proceedings of the Symposium on Eye Tracking Research and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker--listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.