Ontology-Based Relevance Assessment: An Evaluation of Different Semantic Similarity Measures

  • Authors:
  • Michael Ricklefs;Eva Blomqvist

  • Affiliations:
  • Jönköping University, Jönköping, Sweden;Jönköping University, Jönköping, Sweden

  • Venue:
  • OTM '08 Proceedings of the OTM 2008 Confederated International Conferences, CoopIS, DOA, GADA, IS, and ODBASE 2008. Part II on On the Move to Meaningful Internet Systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Ontology-based relevance assessment of documents is an important task. When viewing this in a business context, approaches are commonly based on the use of one ontology describing the enterprise. A more specific problem is then how to assess the relevance of a set of ontology concepts with respect to a user profile expressed within the same ontology. Semantic similarity measures have been widely used and described in literature, but few experiments have been performed to show the benefits and drawbacks of certain measures. In this paper we describe how a set of measures have been combined, tested, and evaluated. The evaluation was performed through a rank correlation coefficient comparing the measured results with a manually constructed "gold standard". Conclusions are that certain combinations of measures seem less suitable for solving this type of problem. On the other hand a set of combinations perform quite well, although the detailed performance of most combined measures seem to depend heavily on the structure of the ontology used.