FaceTube: predicting personality from facial expressions of emotion in online conversational video

  • Authors:
  • Joan-Isaac Biel;Lucía Teijeiro-Mosquera;Daniel Gatica-Perez

  • Affiliations:
  • Ecole Polytechnique Fédérale de Lausanne, Martigny, Switzerland;Univesidad de Vigo, Vigo, Spain;Ecole Polytechnique Fédérale de Lausanne, Martigny, Switzerland

  • Venue:
  • Proceedings of the 14th ACM international conference on Multimodal interaction
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

The advances in automatic facial expression recognition make possible to mine and characterize large amounts of data, opening a wide research domain on behavioral understanding. In this paper, we leverage the use of a state-of-the-art facial expression recognition technology to characterize users of a popular type of online social video, conversational vlogs. First, we propose the use of several activity cues to characterize vloggers based on frame-by-frame estimates of facial expressions of emotion. Then, we present results for the task of automatically predicting vloggers' personality impressions using facial expressions and the Big-Five traits. Our results are promising, specially for the case of the Extraversion impression, and in addition our work poses interesting questions regarding the representation of multiple natural facial expressions occurring in conversational video.