SemEval-2010 task 1: Coreference resolution in multiple languages

Authors:
Marta Recasens;Lluís Màrquez;Emili Sapena;M. Antònia Martí;Mariona Taulé;Véronique Hoste;Massimo Poesio;Yannick Versley
Affiliations:
University of Barcelona;Technical University of Catalonia;Technical University of Catalonia;University of Barcelona;University of Barcelona;University College Ghent;University of Essex/University of Trento;University of Tübingen
Venue:
SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
Year:
2010

Citing 16
Cited 23

A model-theoretic coreference scoring scheme

MUC6 '95 Proceedings of the 6th conference on Message understanding
On coreference resolution performance metrics

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Two uses of anaphora resolution in summarization

Information Processing and Management: an International Journal
OntoNotes: A Unified Relational Semantic Representation

ICSC '07 Proceedings of the International Conference on Semantic Computing
Estimation of conditional probabilities with decision trees and an application to fine-grained POS tagging

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Using coreference for question answering

CorefApp '99 Proceedings of the Workshop on Coreference and its Applications
A unified representation for morphological, syntactic, semantic, and referential annotations

CorpusAnno '05 Proceedings of the Workshop on Frontiers in Corpus Annotations II: Pie in the Sky
A dependency-driven parser for German dependency and constituency representations

PaGe '08 Proceedings of the Workshop on Parsing German
Using decision trees for conference resolution

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
RelaxCor: A global relaxation labeling approach to coreference resolution

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
SUCRE: A modular system for coreference resolution

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
UBIU: A language-independent system for coreference resolution

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
Corry: A system for coreference resolution

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
BART: A multilingual anaphora resolution system

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
TANL-1: Coreference resolution by parse analysis and similarity clustering

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
AnCora-CO: Coreferentially annotated corpora for Spanish and Catalan

Language Resources and Evaluation

Coreference resolution across corpora: languages, coding schemes, and preprocessing information

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
RelaxCor: A global relaxation labeling approach to coreference resolution

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
SUCRE: A modular system for coreference resolution

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
UBIU: A language-independent system for coreference resolution

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
Corry: A system for coreference resolution

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
TANL-1: Coreference resolution by parse analysis and similarity clustering

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
A cross-lingual ILP solution to zero anaphora resolution

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
CoNLL-2011 shared task: modeling unrestricted coreference in OntoNotes

CONLL Shared Task '11 Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task
RelaxCor participation in CoNLL shared task on coreference resolution

CONLL Shared Task '11 Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task
Multi-metric optimization for coreference: the UniTN/IITP/Essex submission to the 2011 CoNLL Shared Task

CONLL Shared Task '11 Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task
Combining syntactic and semantic features by SVM for unrestricted coreference resolution

CONLL Shared Task '11 Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task
Blanc: Implementing the rand index for coreference evaluation

Natural Language Engineering
Analysis and reference resolution of bridge anaphora across different text genres

DAARC'11 Proceedings of the 8th international conference on Anaphora Processing and Applications
Multiobjective simulated annealing based approach for feature selection in anaphora resolution

DAARC'11 Proceedings of the 8th international conference on Anaphora Processing and Applications
Active learning for coreference resolution

NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Translation-based projection for multilingual coreference resolution

NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Combining the best of two worlds: a hybrid approach to multilingual coreference resolution

CoNLL '12 Joint Conference on EMNLP and CoNLL - Shared Task
UBIU for multilingual coreference resolution in OntoNotes

CoNLL '12 Joint Conference on EMNLP and CoNLL - Shared Task
BART goes multilingual: the UniTN/Essex submission to the CoNLL-2012 shared task

CoNLL '12 Joint Conference on EMNLP and CoNLL - Shared Task
Phrase detectives: Utilizing collective intelligence for internet-scale language resource creation

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special section on internet-scale human problem solving and regular papers
Reference resolution in legal texts

Proceedings of the Fourteenth International Conference on Artificial Intelligence and Law
Coreference resolution: an empirical study based on SemEval-2010 shared Task 1

Language Resources and Evaluation
A constraint-based hypergraph partitioning approach to coreference resolution

Computational Linguistics

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the SemEval-2010 task on Coreference Resolution in Multiple Languages. The goal was to evaluate and compare automatic coreference resolution systems for six different languages (Catalan, Dutch, English, German, Italian, and Spanish) in four evaluation settings and using four different metrics. Such a rich scenario had the potential to provide insight into key issues concerning coreference resolution: (i) the portability of systems across languages, (ii) the relevance of different levels of linguistic information, and (iii) the behavior of scoring metrics.