Affect computing in film through sound energy dynamics

  • Authors:
  • Simon Moncrieff;Chitra Dorai;Svetha Venkatesh

  • Affiliations:
  • Curtin University of Technology, Perth, W. Australia;IBM T.J. Watson Research Center, Yorktown Heights, NY;Curtin University of Technology, Perth, W. Australia

  • Venue:
  • MULTIMEDIA '01 Proceedings of the ninth ACM international conference on Multimedia
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

We develop an algorithm for the detection and classification of affective sound events underscored by specific patterns of sound energy dynamics. We relate the portrayal of these events to proposed high level affect or emotional coloring of the events. In this paper, four possible characteristic sound energy events are identified that convey well established meanings through their dynamics to portray and deliver certain affect, sentiment related to the horror film genre. Our algorithm is developed with the ultimate aim of automatically structuring sections of films that contain distinct shades of emotion related to horror themes for nonlinear media access and navigation. An average of 82% of the energy events, obtained from the analysis of the audio tracks of sections of four sample films corresponded correctly to the proposed affect. While the discrimination between certain sound energy event types was low, the algotithm correctly detected 71% of the occurrences of the sound energy events within audio tracks of the films analyzed, and thus forms a useful basis for determining affective scenes characteristic of horror in movies.