Automatic detection of dominance and expected interest

  • Authors:
  • Sergio Escalera;Oriol Pujol;Petia Radeva;Jordi Vitrià;M. Teresa Anguera

  • Affiliations:
  • Computer Vision Center, Bellaterra, Spain and Departament de Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain;Computer Vision Center, Bellaterra, Spain and Departament de Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain;Computer Vision Center, Bellaterra, Spain and Departament de Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain;Computer Vision Center, Bellaterra, Spain and Departament de Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain;Departament de Metodologia de les Ciències del Comportament, Universitat de Barcelona, Barcelona, Spain

  • Venue:
  • EURASIP Journal on Advances in Signal Processing
  • Year:
  • 2010

Quantified Score

Hi-index 0.01

Visualization

Abstract

Social Signal Processing is an emergent area of research that focuses on the analysis of social constructs. Dominance and interest are two of these social constructs. Dominance refers to the level of influence a person has in a conversation. Interest, when referred in terms of group interactions, can be defined as the degree of engagement that the members of a group collectively display during their interaction. In this paper, we argue that only using behavioral motion information, we are able to predict the interest of observers when looking at face-to-face interactions as well as the dominant people. First, we propose a simple set of movement-based features from body, face, and mouth activity in order to define a higher set of interaction indicators. The considered indicators are manually annotated by observers. Based on the opinions obtained, we define an automatic binary dominance detection problem and amulticlass interest quantification problem. Error-Correcting Output Codes framework is used to learn to rank the perceived observer's interest in face-to-face interactions meanwhile Adaboost is used to solve the dominant detection problem. The automatic system shows good correlation between the automatic categorization results and the manual ranking made by the observers in both dominance and interest detection problems.