Multi-actor emotion recognition in movies using a bimodal approach

  • Authors:
  • Ruchir Srivastava;Sujoy Roy;Shuicheng Yan;Terence Sim

  • Affiliations:
  • Dept. of Electrical and Computer Engineering, National University of Singapore, Singapore;Institute for Infocomm Research, Connexis, Singapore;Dept. of Electrical and Computer Engineering, National University of Singapore, Singapore;School of Computing, National University of Singapore, Singapore

  • Venue:
  • MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Approaches for emotion recognition in movie scenes using high level features, consider emotion of only a single actor. The contribution of this paper is to analyze using emotional information from multiple actors present in the scene instead of just one actor. A bimodal approach is proposed for fusing emotional cues from different actors using two different fusion methods. Emotional cues are obtained from facial expressions and dialogs. Experimental observations show that emotions of other actors do not necessarily provide helpful information about the emotion of the scene and recognition accuracy is better when emotions of only the speaker are considered.