Emotive captioning

  • Authors:
  • DANIEL G. LEE;DEBORAH I. FELS;JOHN PATRICK UDO

  • Affiliations:
  • Ryerson University, Toronto;Ryerson University, Toronto;Ryerson University, Toronto

  • Venue:
  • Computers in Entertainment (CIE) - Interactive TV
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Television and film have become important equalization mechanisms for the dissemination and distribution of cultural materials. Closed captioning has allowed people who are deaf and hard of hearing to be included as audience members. However, some of the audio information such as music, sound effects, and speech prosody are not generally provided for in captioning. To include some of this information in closed captions, we generated graphical representations of the emotive information that is normally represented with nondialog sound. Eleven deaf and hard of hearing viewers watched two different video clips containing static and dynamic enhanced captions and compared them with conventional closed captions of the same clips. These viewers then provided verbal and written feedback regarding positive and negative aspects of the various captions. We found that hard of hearing viewers were significantly more positive about this style of captioning than deaf viewers and that some viewers believed that these augmentations were useful and enhanced their viewing experience.