How we BLESSed distributional semantic evaluation

  • Authors:
  • Marco Baroni;Alessandro Lenci

  • Affiliations:
  • University of Trento, Trento, Italy;University of Pisa, Pisa, Italy

  • Venue:
  • GEMS '11 Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce BLESS, a data set specifically designed for the evaluation of distributional semantic models. BLESS contains a set of tuples instantiating different, explicitly typed semantic relations, plus a number of controlled random tuples. It is thus possible to assess the ability of a model to detect truly related word pairs, as well as to perform in-depth analyses of the types of semantic relations that a model favors. We discuss the motivations for BLESS, describe its construction and structure, and present examples of its usage in the evaluation of distributional semantic models.