A gaze-based method for relating group involvement to individual engagement in multimodal multiparty dialogue

Authors:
Catharine Oertel;Giampiero Salvi
Affiliations:
KTH The Royal Institute of Technology, Stockholm, Sweden;KTH The Royal Institute of Technology, Stockholm, Sweden
Venue:
Proceedings of the 15th ACM on International conference on multimodal interaction
Year:
2013

Citing 10
Cited 1

Automatic Analysis of Multimodal Group Actions in Meetings

IEEE Transactions on Pattern Analysis and Machine Intelligence
Models for multiparty engagement in open-world dialog

SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Attention and interaction control in a human-human-computer dialogue setting

SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Automatic role recognition in multiparty recordings: using social affiliation networks for feature extraction

IEEE Transactions on Multimedia
An empirical study of eye-gaze behaviors: towards the estimation of conversational engagement in human-agent communication

Proceedings of the 2010 workshop on Eye gaze in intelligent human machine interaction
Detecting levels of interest from spoken dialog with multistream prediction feedback and similarity based hierarchical fusion learning

SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
Towards the automatic detection of involvement in conversation

COST'10 Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and Enactment
Gaze and conversational engagement in multiparty video conversation: an annotation scheme and classification of high and low levels of engagement

Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
Visual interaction and conversational activity

Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
How Do We React to Context? Annotation of Individual and Group Engagement in a Video Corpus

SOCIALCOM-PASSAT '12 Proceedings of the 2012 ASE/IEEE International Conference on Social Computing and 2012 ASE/IEEE International Conference on Privacy, Security, Risk and Trust

Towards developing a model for group involvement and individual engagement

Proceedings of the 15th ACM on International conference on multimodal interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper is concerned with modelling individual engagement and group involvement as well as their relationship in an eight-party, mutimodal corpus. We propose a number of features (presence, entropy, symmetry and maxgaze) that summarise different aspects of eye-gaze patterns and allow us to describe individual as well as group behaviour in time. We use these features to define similarities between the subjects and we compare this information with the engagement rankings the subjects expressed at the end of each interactions about themselves and the other participants. We analyse how these features relate to four classes of group involvement and we build a classifier that is able to distinguish between those classes with 71\% of accuracy.