FBK: machine translation evaluation and word similarity metrics for semantic textual similarity

  • Authors:
  • José Guilherme C. de Souza;Matteo Negri;Yashar Mehdad

  • Affiliations:
  • Fondazione Bruno Kessler University of Trento Povo, Trento, Italy;Fondazione Bruno Kessler Povo, Trento Italy;Fondazione Bruno Kessler Povo, Trento Italy

  • Venue:
  • SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes the participation of FBK in the Semantic Textual Similarity (STS) task organized within Semeval 2012. Our approach explores lexical, syntactic and semantic machine translation evaluation metrics combined with distributional and knowledge-based word similarity metrics. Our best model achieves 60.77% correlation with human judgements (Mean score) and ranked 20 out of 88 submitted runs in the Mean ranking, where the average correlation across all the sub-portions of the test set is considered.