Move, and i will tell you who you are: detecting deceptive roles in low-quality data

  • Authors:
  • Nimrod Raiman;Hayley Hung;Gwenn Englebienne

  • Affiliations:
  • university of Amsterdam, Amsterdam, Netherlands;university of Amsterdam, Amsterdam, Netherlands;university of Amsterdam, Amsterdam, Netherlands

  • Venue:
  • ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Motion, like speech, provides information about one's emotional state. This work introduces an automated non-verbal audio-visual approach for detecting deceptive roles in multi-party conversations using low resolution video. We show how using simple features extracted from motion and speech improves over speech-only for the detection of deceptive roles. Our results show that deceptive players were recognised with significantly higher precision when video features were used. We improve the classification performance with 22.6% compared to our baseline.