SemEval-2012 task 2: measuring degrees of relational similarity

Authors:
David A. Jurgens;Peter D. Turney;Saif M. Mohammad;Keith J. Holyoak
Affiliations:
University of California, Los Angeles;Emerging Technologies National Research Council Canada;Emerging Technologies National Research Council Canada;University of California, Los Angeles
Venue:
SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Year:
2012

Citing 13
Cited 4

Word association norms, mutual information, and lexicography

Computational Linguistics
Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL

EMCL '01 Proceedings of the 12th European Conference on Machine Learning
Corpus-based Learning of Analogies and Semantic Relations

Machine Learning
Similarity of Semantic Relations

Computational Linguistics
Espresso: leveraging generic patterns for automatically harvesting semantic relations

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Learning noun-modifier semantic relations with corpus-based and WordNet-based features

AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
SemEval-2007 task 04: classification of semantic relations between nominals

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
The latent relation mapping engine: algorithm and experiments

Journal of Artificial Intelligence Research
Measuring semantic similarity by latent relational analysis

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
SemEval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
SemEval-2010 task 9: The interpretation of noun compounds using paraphrasing verbs and prepositions

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
Emotions evoked by common words and phrases: using mechanical turk to create an emotion lexicon

CAAGET '10 Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text

UTD: determining relational similarity using lexical patterns

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Duluth: measuring degrees of relational similarity with the gloss vector measure of semantic relatedness

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
BUAP: a first approximation to relational similarity measuring

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Domain and function: a dual-space model of semantic relations and compositions

Journal of Artificial Intelligence Research

Quantified Score

Hi-index	0.00

Visualization

Abstract

Up to now, work on semantic relations has focused on relation classification: recognizing whether a given instance (a word pair such as virus:flu) belongs to a specific relation class (such as CAUSE:EFFECT). However, instances of a single relation class may still have significant variability in how characteristic they are of that class. We present a new SemEval task based on identifying the degree of prototypicality for instances within a given class. As a part of the task, we have assembled the first dataset of graded relational similarity ratings across 79 relation categories. Three teams submitted six systems, which were evaluated using two methods.