Third message understanding evaluation and conference (MUC-3): phase 1 status report
HLT '91 Proceedings of the workshop on Speech and Natural Language
Distant supervision for relation extraction without labeled data
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
Bioinformatics
Complex event extraction at PubMed scale
Bioinformatics
Beyond NomBank: a study of implicit arguments for nominal predicates
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Integration of static relations to enhance event extraction from text
BioNLP '10 Proceedings of the 2010 Workshop on Biomedical Natural Language Processing
Modeling relations and their mentions without labeled text
ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part III
Template-based information extraction without the templates
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Event extraction as dependency parsing
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
EVEX: a pubmed-scale resource for homology-based generalization of text mining predictions
BioNLP '11 Proceedings of BioNLP 2011 Workshop
Overview of BioNLP Shared Task 2011
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Overview of Genia event task in BioNLP Shared Task 2011
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Overview of the infectious diseases (ID) task of BioNLP Shared Task 2011
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Biomedical event extraction from abstracts and full papers using search-based structured prediction
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Model combination for event extraction in BioNLP 2011
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
BioNLP Shared Task 2011: bacteria biotope
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
BioNLP Shared Task 2011: bacteria gene interactions and renaming
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Overview of the protein coreference task in BioNLP Shared Task 2011
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Overview of the entity relations (REL) supporting task of BioNLP Shared Task 2011
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
BioNLP Shared Task 2011: supporting resources
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Extracting biological events from text using simple syntactic patterns
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Detecting entity relations as a supporting task for bio-molecular event extraction
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
A pattern approach for biomedical event annotation
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Double layered learning for biological event extraction from text
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
MSR-NLP entry in BioNLP Shared Task 2011
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
From graphs to events: a subgraph matching approach for information extraction from biomedical text
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Adapting a general semantic interpretation approach to biological event extraction
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Generalizing biomedical event extraction
BioNLP Shared Task '11 Proceedings of the BioNLP Shared Task 2011 Workshop
Fast and robust joint models for biomedical event extraction
EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
ExProM '12 Proceedings of the Workshop on Extra-Propositional Aspects of Meaning in Computational Linguistics
| Hi-index | 0.00 |
Event extraction is a major focus of recent work in biomedical information extraction. Despite substantial advances, many challenges still remain for reliable automatic extraction of events from text. We introduce a new biomedical event extraction resource consisting of analyses automatically created by systems participating in the recent BioNLP Shared Task (ST) 2011. In providing for the first time the outputs of a broad set of state-of-the-art event extraction systems, this resource opens many new opportunities for studying aspects of event extraction, from the identification of common errors to the study of effective approaches to combining the strengths of systems. We demonstrate these opportunities through a multi-system analysis on three BioNLP ST 2011 main tasks, focusing on events that none of the systems can successfully extract. We further argue for new perspectives to the performance evaluation of domain event extraction systems, considering a document-level, "off-the-page" representation and evaluation to complement the mention-level evaluations pursued in most recent work.