SemEval-2007 task 17: English lexical sample, SRL and all words

Authors:
Sameer S. Pradhan;Edward Loper;Dmitriy Dligach;Martha Palmer
Affiliations:
BBN Technologies, Cambridge, MA;University of Pennsylvania, Philadelphia, PA;University of Colorado, Boulder, CO;University of Colorado, Boulder, CO
Venue:
SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Year:
2007

Citing 5
Cited 61

Building a sense tagged corpus with open mind word expert

WSD '02 Proceedings of the ACL-02 workshop on Word sense disambiguation: recent successes and future directions - Volume 8
The Proposition Bank: An Annotated Corpus of Semantic Roles

Computational Linguistics
An empirical study of the behavior of active learning for word sense disambiguation

HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
OntoNotes: the 90% solution

NAACL-Short '06 Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers
Introduction to the CoNLL-2005 shared task: semantic role labeling

CONLL '05 Proceedings of the Ninth Conference on Computational Natural Language Learning

Wikify!: linking documents to encyclopedic knowledge

Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Semantic role labeling: an introduction to the special issue

Computational Linguistics
Word sense disambiguation: A survey

ACM Computing Surveys (CSUR)
The bootstrapping of the Yarowsky algorithm in real corpora

Information Processing and Management: an International Journal
An investigation into feature construction to assist word sense disambiguation

Machine Learning
Web-derived resources for web information retrieval: from conceptual hierarchies to attribute hierarchies

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Overview of a semantic disambiguation method for unstructured web contexts

Proceedings of the fifth international conference on Knowledge capture
On robustness and domain adaptation using SVD for word sense disambiguation

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
OntoNotes: corpus cleanup of mistaken agreement using word sense disambiguation

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Personalizing PageRank for word sense disambiguation

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Supervised domain adaption for WSD

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Outclassing Wikipedia in open-domain information extraction: weakly-supervised acquisition of attributes over conceptual hierarchies

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Turning web text and search queries into factual knowledge: hierarchical class attribute extraction

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
KU: word sense disambiguation by substitution

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
PUTOP: turning predominant senses into a topic model for word sense disambiguation

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Tor, TorMd: distributional profiles of concepts for unsupervised word sense disambiguation

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Improvements to monolingual English word sense disambiguation

DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
SemEval-2010 task 7: argument selection and coercion

DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
SemEval-2010 task 17: all-words word sense disambiguation on a specific domain

DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
Knowledge-based WSD on specific domains: performing better than generic supervised WSD

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Word sense disambiguation for all words without hard labor

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Kernel methods for minimally supervised wsd

Computational Linguistics
A multiclassifier based approach for word sense disambiguation using Singular Value Decomposition

IWCS-8 '09 Proceedings of the Eighth International Conference on Computational Semantics
WordNet and FrameNet as complementary resources for annotation

ACL-IJCNLP '09 Proceedings of the Third Linguistic Annotation Workshop
Wikipedia as frame information repository

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
A Reexamination of MRD-Based Word Sense Disambiguation

ACM Transactions on Asian Language Information Processing (TALIP)
Automatic word sense disambiguation based on document networks

Programming and Computing Software
A preliminary study on the robustness and generalization of role sets for semantic role labeling

CICLing'08 Proceedings of the 9th international conference on Computational linguistics and intelligent text processing
Disambiguation of ambiguous biomedical terms using examples generated from the UMLS Metathesaurus

Journal of Biomedical Informatics
The effect of ambiguity on the automated acquisition of WSD examples

HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Extracting glosses to disambiguate word senses

HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Combining orthogonal monolingual and multilingual sources of evidence for all words WSD

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
It makes sense: a wide-coverage word sense disambiguation system for free text

ACLDemos '10 Proceedings of the ACL 2010 System Demonstrations
SemEval-2010 task 17: All-words word sense disambiguation on a specific domain

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
COLEUR and COLSLM: A WSD approach to multilingual lexical substitution, tasks 2 and 3 SemEval 2010

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
RALI: Automatic weighting of text window distances

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
Extracting sense-disambiguated example sentences from parallel corpora

WDE '09 Proceedings of the 1st Workshop on Definition Extraction
Robust and efficient page rank for word sense disambiguation

TextGraphs-5 Proceedings of the 2010 Workshop on Graph-based Methods for Natural Language Processing
Co-occurrence cluster features for lexical substitutions in context

TextGraphs-5 Proceedings of the 2010 Workshop on Graph-based Methods for Natural Language Processing
What is word meaning, really?: (and how can distributional models help us describe it?)

GEMS '10 Proceedings of the 2010 Workshop on GEometrical Models of Natural Language Semantics
Assessing the contribution of shallow and deep knowledge sources for word sense disambiguation

Language Resources and Evaluation
Towards an optimal weighting of context words based on distance

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
CLEF 2009 ad hoc track overview: robust-WSD task

CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
Indexing with wordnet synonyms may improve retrieval results

CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
Using wordnet relations and semantic classes in information retrieval tasks

CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
Unsupervised word sense disambiguation with lexical chains and graph-based context formalization

LTC'09 Proceedings of the 4th conference on Human language technology: challenges for computer science and linguistics
Word sense disambiguation with multilingual features

IWCS '11 Proceedings of the Ninth International Conference on Computational Semantics
Finding the optimal number of clusters for word sense disambiguation

TSD'11 Proceedings of the 14th international conference on Text, speech and dialogue
Semantic topic models: combining word distributional statistics and dictionary definitions

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Unsupervised similarity-based word sense disambiguation using context vectors and sentential word importance

ACM Transactions on Speech and Language Processing (TSLP)
Mining class association rules for word sense disambiguation

SIIS'11 Proceedings of the 2011 international conference on Security and Intelligent Information Systems
A quick tour of word sense disambiguation, induction and related approaches

SOFSEM'12 Proceedings of the 38th international conference on Current Trends in Theory and Practice of Computer Science
Resolving ambiguity in biomedical text to improve summarization

Information Processing and Management: an International Journal
Evaluation of clustering algorithms for word sense disambiguation

International Journal of Data Analysis Techniques and Strategies
Multiplicity and word sense: evaluating and learning from multiply labeled word sense annotations

Language Resources and Evaluation
Unsupervised disambiguation of image captions

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
BabelNet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic network

Artificial Intelligence
Wikipedia-based WSD for multilingual frame annotation

Artificial Intelligence
Empirical methods for the study of denotation in nominalizations in spanish

Computational Linguistics
Creating a system for lexical substitutions from scratch using crowdsourcing

Language Resources and Evaluation

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes our experience in preparing the data and evaluating the results for three subtasks of SemEval-2007 Task-17 - Lexical Sample, Semantic Role Labeling (SRL) and All-Words respectively. We tabulate and analyze the results of participating systems.