The annotation scheme of the Turkish Discourse Bank and an evaluation of inconsistent annotations

Authors:
Deniz Zeyrek;Işin Demirşahin;Ayişiği Sevdik-Çalli;Hale Ögel Balaban;İhsan Yalçinkaya;Ümit Deniz Turan
Affiliations:
Middle East Technical University, Ankara, Turkey;Middle East Technical University, Ankara, Turkey;Middle East Technical University, Ankara, Turkey;Middle East Technical University, Ankara, Turkey;Middle East Technical University, Ankara, Turkey;Anadolu University, Eskişehir, Turkey
Venue:
LAW IV '10 Proceedings of the Fourth Linguistic Annotation Workshop
Year:
2010

Citing 6
Cited 5

All I really need to know about pair programming I learned in kindergarten

Communications of the ACM
Strengthening the Case for Pair Programming

IEEE Software
The kappa statistic: a second look

Computational Linguistics
Anaphora and Discourse Structure

Computational Linguistics
Inter-coder agreement for computational linguistics

Computational Linguistics
Annotating subordinators in the Turkish Discourse Bank

ACL-IJCNLP '09 Proceedings of the Third Linguistic Annotation Workshop

Discourse structure in simultaneous spoken Turkish

ACL '12 Proceedings of ACL 2012 Student Research Workshop
Discourse structure and computation: past, present and future

ACL '12 Proceedings of the ACL-2012 Special Workshop on Rediscovering 50 Years of Discoveries
Pair annotation: adaption of pair programming to corpus annotation

LAW VI '12 Proceedings of the Sixth Linguistic Annotation Workshop
Discourse structure and language technology

Natural Language Engineering
Assessment of different workflow strategies for annotating discourse relations: a case study with HDRB

CICLing'13 Proceedings of the 14th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we report on the annotation procedures we developed for annotating the Turkish Discourse Bank (TDB), an effort that extends the Penn Discourse Tree Bank (PDTB) annotation style by using it for annotating Turkish discourse. After a brief introduction to the TDB, we describe the annotation cycle and the annotation scheme we developed, defining which parts of the scheme are an extension of the PDTB and which parts are different. We provide inter-coder reliability calculations on the first and second arguments of some connectives and discuss the most important sources of disagreement among annotators.