SemEval-2007 task 01: evaluating WSD on cross-language information retrieval

Authors:
Eneko Agirre;Bernardo Magnini;Oier Lopez de Lacalle;Arantxa Otegi;German Rigau;Piek Vossen
Affiliations:
University of the Basque Country, Donostia, Basque Country;ITC-IRST, Trento, Italy;University of the Basque Country, Donostia, Basque Country;University of the Basque Country, Donostia, Basque Country;University of the Basque Country, Donostia, Basque Country;Irion Technologies, Delftechpark, Delft, Netherlands
Venue:
SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Year:
2007

Citing 1
Cited 6

Mapping WordNets using structural information

ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics

Word sense disambiguation: A survey

ACM Computing Surveys (CSUR)
PUTOP: turning predominant senses into a topic model for word sense disambiguation

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
UNIBA: JIGSAW algorithm for word sense disambiguation

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Combining knowledge-based methods and supervised learning for effective Italian word sense disambiguation

STEP '08 Proceedings of the 2008 Conference on Semantics in Text Processing
Exploiting Disambiguation and Discrimination in Information Retrieval Systems

WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 03
SemEval-2010 task 3: Cross-lingual word sense disambiguation

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a first attempt of an application-driven evaluation exercise of WSD. We used a CLIR testbed from the Cross Lingual Evaluation Forum. The expansion, indexing and retrieval strategies where fixed by the organizers. The participants had to return both the topics and documents tagged with WordNet 1.6 word senses. The organization provided training data in the form of a pre-processed Semcor which could be readily used by participants. The task had two participants, and the organizer also provide an in-house WSD system for comparison.