Pair annotation: adaption of pair programming to corpus annotation

  • Authors:
  • Işın Demirşahin;Ihsan Yalçınkaya;Deniz Zeyrek

  • Affiliations:
  • Middle East Technical University, Ankara, Turkey;Middle East Technical University, Ankara, Turkey;Middle East Technical University, Ankara, Turkey

  • Venue:
  • LAW VI '12 Proceedings of the Sixth Linguistic Annotation Workshop
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper will introduce a procedure that we call pair annotation after pair programming. We describe initial annotation procedure of the TDB, followed by the inception of the pair annotation idea and how it came to be used in the Turkish Discourse Bank. We discuss the observed benefits and issues encountered during the process, and conclude by discussing the major benefit of pair annotation, namely higher inter-annotator agreement values.