Tower of babel: a crowdsourcing game building sentiment lexicons for resource-scarce languages

  • Authors:
  • Yoonsung Hong;Haewoon Kwak;Youngmin Baek;Sue Moon

  • Affiliations:
  • KAIST, Daejon, South Korea;Telefónica Research, Barcelona, Spain;Yonsei University, Seoul, South Korea;KAIST, Daejon, South Korea

  • Venue:
  • Proceedings of the 22nd international conference on World Wide Web companion
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.