(Linear) maps of the impossible: capturing semantic anomalies in distributional space

  • Authors:
  • Eva Maria Vecchi;Marco Baroni;Roberto Zamparelli

  • Affiliations:
  • University of Trento, Rovereto (TN), Italy;University of Trento, Rovereto (TN), Italy;University of Trento, Rovereto (TN), Italy

  • Venue:
  • DiSCo '11 Proceedings of the Workshop on Distributional Semantics and Compositionality
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a first attempt to characterize the semantic deviance of composite expressions in distributional semantics. Specifically, we look for properties of adjective-noun combinations within a vector-based semantic space that might cue their lack of meaning. We evaluate four different compositionality models shown to have various levels of success in representing the meaning of AN pairs: the simple additive and multiplicative models of Mitchell and Lapata (2008), and the linear-map-based models of Guevara (2010) and Baroni and Zamparelli (2010). For each model, we generate composite vectors for a set of AN combinations unattested in the source corpus and which have been deemed either acceptable or semantically deviant. We then compute measures that might cue semantic anomaly, and compare each model's results for the two classes of ANs. Our study shows that simple, unsupervised cues can indeed significantly tell unattested but acceptable ANs apart from impossible, or deviant, ANs, and that the simple additive and multiplicative models are the most effective in this task.