The CoNLL-2009 shared task: syntactic and semantic dependencies in multiple languages

Authors:
Jan Hajič;Massimiliano Ciaramita;Richard Johansson;Daisuke Kawahara;Maria Antònia Martí;Lluís Màrquez;Adam Meyers;Joakim Nivre;Sebastian Padó;Jan Štěpánek;Pavel Straňák;Mihai Surdeanu;Nianwen Xue;Yi Zhang
Affiliations:
Charles University in Prague;Google Inc.;University of Trento;National Institute of Information and Communications Technology;University of Barcelona;Technical University of Catalonia, Barcelona;New York University;Uppsala University and Växjö University;Stuttgart University;Charles University in Prague;Charles University in Prague;Stanford University;Brandeis University;Saarland University
Venue:
CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Year:
2009

Citing 16
Cited 77

Building a large annotated corpus of English: the penn treebank

Computational Linguistics - Special issue on using large corpora: II
The Penn Chinese TreeBank: Phrase structure annotation of a large corpus

Natural Language Engineering
The Proposition Bank: An Annotated Corpus of Semantic Roles

Computational Linguistics
Non-projective dependency parsing using spanning tree algorithms

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Cross-linguistic projection of role-semantic information

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Adding semantic roles to the chinese treebank

Natural Language Engineering
Morphisto --An Open Source Morphological Analyzer for German

Proceedings of the 2009 conference on Finite-State Methods and Natural Language Processing: Post-proceedings of the 7th International Workshop FSMNLP 2008
The CoNLL-2008 shared task on joint parsing of syntactic and semantic dependencies

CoNLL '08 Proceedings of the Twelfth Conference on Computational Natural Language Learning
An iterative approach for joint dependency parsing and semantic role labeling

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
A latent variable model of synchronous syntactic-semantic parsing for multiple languages

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
A second-order joint eisner model for syntactic and semantic dependency parsing

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
A simple generative pipeline approach to dependency parsing and semantic role labeling

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Recent advances in a feature-rich framework for treebank annotation

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Semi-supervised training for the averaged perceptron POS tagger

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
SemEval-2007 task 09: multilevel semantic annotation of Catalan and Spanish

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Cat3LB and Cast3LB: from constituents to dependencies

FinTAL'06 Proceedings of the 5th international conference on Advances in Natural Language Processing

An iterative approach for joint dependency parsing and semantic role labeling

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Joint memory-based learning of syntactic and semantic dependencies in multiple languages

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Hybrid multilingual parsing with HPSG for SRL

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
A latent variable model of synchronous syntactic-semantic parsing for multiple languages

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Multilingual semantic role labeling

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Multilingual dependency-based syntactic and semantic parsing

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Multilingual dependency learning: a huge feature engineering method to semantic dependency parsing

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Multilingual dependency learning: exploiting rich features for tagging syntactic and semantic dependencies

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Efficient parsing of syntactic and semantic dependency structures

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Exploring multilingual semantic role labeling

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
A second-order joint eisner model for syntactic and semantic dependency parsing

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Multilingual semantic role labelling with Markov logic

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
The crotal SRL system: a generic tool based on tree-structured CRF

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Parsing syntactic and semantic dependencies for multiple languages with a pipeline approach

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Multilingual semantic parsing with a pipeline of linear classifiers

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
A joint syntactic and semantic dependency parsing system based on maximum entropy models

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Multilingual syntactic-semantic dependency parsing with three-stage approximate max-margin linear models

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
A simple generative pipeline approach to dependency parsing and semantic role labeling

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task
Automatic recognition of logical relations for English, Chinese and Japanese in the GLARF framework

DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
Transducing logical relations from automatic and manual GLARF

ACL-IJCNLP '09 Proceedings of the Third Linguistic Annotation Workshop
Semantic dependency parsing of NomBank and PropBank: an efficient integrated approach via a large-scale feature selection

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Recognizing textual relatedness with predicate-argument structures

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2
Joint inference for knowledge extraction from biomedical literature

HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Joint syntactic and semantic parsing of Chinese

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Beyond NomBank: a study of implicit arguments for nominal predicates

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
A structured model for joint learning of argument roles and predicate senses

ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
Semantics-driven shallow parsing for Chinese semantic role labeling

ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
Edit tree distance alignments for semantic role labelling

ACLstudent '10 Proceedings of the ACL 2010 Student Research Workshop
Retrieving correct semantic boundaries in dependency structure

LAW IV '10 Proceedings of the Fourth Linguistic Annotation Workshop
Dependency-based PropBanking of clinical Finnish

LAW IV '10 Proceedings of the Fourth Linguistic Annotation Workshop
What a parser can learn from a semantic role labeler and vice versa

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Very high accuracy and fast dependency parsing is not a contradiction

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Broad coverage multilingual deep sentence generation with a stochastic multi-level realizer

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Jointly modeling WSD and SRL with Markov logic

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
2D Trie for fast parsing

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
A minimum error weighting combination strategy for Chinese semantic role labeling

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
TectoMT: modular NLP framework

IceTAL'10 Proceedings of the 7th international conference on Advances in natural language processing
LTP: a Chinese Language Technology Platform

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Demonstrations
A high-performance syntactic and semantic dependency parser

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Demonstrations
Combining constituent and dependency syntactic views for Chinese semantic role labeling

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Informed ways of improving data-driven dependency parsing for German

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Tree kernel-based semantic role labeling with enriched parse tree structure

Information Processing and Management: an International Journal
Event extraction as dependency parsing

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Temporal restricted Boltzmann machines for dependency parsing

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Getting the most out of transition-based dependency parsing

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Transition-based semantic role labeling using predicate argument clustering

RELMS '11 Proceedings of the ACL 2011 Workshop on Relational Models of Semantics
Unsupervised multilingual learning

Unsupervised multilingual learning
CoNLL-2011 shared task: modeling unrestricted coreference in OntoNotes

CONLL Shared Task '11 Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task
Joint models for Chinese POS tagging and dependency parsing

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
A fast, accurate, non-projective, semantically-enriched parser

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
A proposal for a Spanish surface realization shared task

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
Analysis of the difficulties in Chinese deep parsing

IWPT '11 Proceedings of the 12th International Conference on Parsing Technologies
On the role of explicit morphological feature representation in syntactic dependency parsing for German

IWPT '11 Proceedings of the 12th International Conference on Parsing Technologies
Statistical dependency parsing in Korean: from corpus generation to automatic parsing

SPMRL '11 Proceedings of the Second Workshop on Statistical Parsing of Morphologically Rich Languages
Towards semi-supervised brazilian portuguese semantic role labeling: building a benchmark

PROPOR'12 Proceedings of the 10th international conference on Computational Processing of the Portuguese Language
Online latent structure training for language acquisition

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
Adaptive Bayesian HMM for Fully Unsupervised Chinese Part-of-Speech Induction

ACM Transactions on Asian Language Information Processing (TALIP)
A Bayesian approach to unsupervised semantic role induction

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Dependency parsing of Hungarian: baseline results and challenges

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Chinese semantic dependency parsing with third-order features

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
ICT: a system combination for chinese semantic dependency parsing

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Unsupervised induction of frame-semantic representations

WILS '12 Proceedings of the NAACL-HLT Workshop on the Induction of Linguistic Structure
Crosslingual induction of semantic roles

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Exploiting multiple treebanks for parsing with quasi-synchronous grammars

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
A comparison of Chinese parsers for stanford dependencies

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 2
Improving NLP through marginalization of hidden syntactic structure

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Generating non-projective word order in statistical linearization

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
A transition-based system for joint part-of-speech tagging and labeled non-projective dependency parsing

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Structural linguistics and unsupervised information extraction

AKBC-WEKEX '12 Proceedings of the Joint Workshop on Automatic Knowledge Base Construction and Web-scale Knowledge Extraction
Who did what to whom?: a contrastive study of syntacto-semantic dependencies

LAW VI '12 Proceedings of the Sixth Linguistic Annotation Workshop
Using parallel features in parsing of machine-translated sentences for correction of grammatical errors

SSST-6 '12 Proceedings of the Sixth Workshop on Syntax, Semantics and Structure in Statistical Translation
Semantic analysis of FBI news reports

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part IV
Dependency-based semantic role labeling using sequence labeling with a structural SVM

Pattern Recognition Letters
Morphological and syntactic case in statistical dependency parsing

Computational Linguistics
Integrative semantic dependency parsing via efficient large-scale feature selection

Journal of Artificial Intelligence Research
ReliAble dependency arc recognition

Expert Systems with Applications: An International Journal
Multilingual joint parsing of syntactic and semantic dependencies with a latent variable model

Computational Linguistics

Quantified Score

Hi-index	0.00

Visualization

Abstract

For the 11th straight year, the Conference on Computational Natural Language Learning has been accompanied by a shared task whose purpose is to promote natural language processing applications and evaluate them in a standard setting. In 2009, the shared task was dedicated to the joint parsing of syntactic and semantic dependencies in multiple languages. This shared task combines the shared tasks of the previous five years under a unique dependency-based formalism similar to the 2008 task. In this paper, we define the shared task, describe how the data sets were created and show their quantitative properties, report the results and summarize the approaches of the participating systems.