The importance of visual context clues in multimedia translation

  • Authors:
  • Christopher G. Harris;Tao Xu

  • Affiliations:
  • Informatics Program, The University of Iowa, Iowa City, IA;School of Foreign Languages, Tongji University, Shanghai, China

  • Venue:
  • CLEF'11 Proceedings of the Second international conference on Multilingual and multimodal information access evaluation
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

As video-sharing websites such as YouTube proliferate, the ability to rapidly translate video clips into multiple languages has become an essential component for enhancing their global reach and impact. Moreover, the ability to provide closed captioning in a variety of languages is paramount to reach a wider variety of viewers. We investigate the importance of visual context clues by comparing transcripts of multimedia clips (which allow transcriptionists to make use of visual context clues in their translations) with their corresponding written transcripts (which do not). Additionally, we contrast translations produced using crowdsourcing workers with those made by professional translators on cost and quality. Finally, we evaluate several genres of multimedia to examine the effects of visual context clues on each and demonstrate the results through heat maps.