3D corpus of spontaneous complex mental states

  • Authors:
  • Marwa Mahmoud;Tadas Baltrušaitis;Peter Robinson;Laurel D. Riek

  • Affiliations:
  • Univeristy of Cambridge, United Kingdom;Univeristy of Cambridge, United Kingdom;Univeristy of Cambridge, United Kingdom;University of Notre Dame, United States

  • Venue:
  • ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Hand-over-face gestures, a subset of emotional body language, are overlooked by automatic affect inference systems. We propose the use of hand-over-face gestures as a novel affect cue for automatic inference of cognitive mental states. Moreover, affect recognition systems rely on the existence of publicly available datasets, often the approach is only as good as the data. We present the collection and annotation methodology of a 3D multimodal corpus of 108 audio/video segments of natural complex mental states. The corpus includes spontaneous facial expressions and hand gestures labelled using crowd-sourcing and is publicly available.