Multi-modal social signal analysis for predicting agreement in conversation settings

  • Authors:
  • Víctor Ponce-López;Sergio Escalera;Xavier Baró

  • Affiliations:
  • Open University of Catalonia, Barcelona, Spain;University of Barcelona, Barcelona, Spain;Open University of Catalonia, Barcelona, Spain

  • Venue:
  • Proceedings of the 15th ACM on International conference on multimodal interaction
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present a non-invasive ambient intelligence framework for the analysis of non-verbal communication applied to conversational settings. In particular, we apply feature extraction techniques to multi-modal audio-RGB-depth data. We compute a set of behavioral indicators that define communicative cues coming from the fields of psychology and observational methodology. We test our methodology over data captured in victim-offender mediation scenarios. Using different state-of-the-art classification approaches, our system achieve upon 75% of recognition predicting agreement among the parts involved in the conversations, using as ground truth the experts opinions.