Corpus-based terminological evaluation of ontologies

  • Authors:

  • Marco Rospocher;Sara Tonelli;Luciano Serafini;Emanuele Pianta

  • Affiliations:

  • Fondazione Bruno Kessler-irst, Via Sommarive 18 Povo, I-38123, Trento, Italy. E-mails: {rospocher, satonelli, serafini, pianta}@fbk.eu;Fondazione Bruno Kessler-irst, Via Sommarive 18 Povo, I-38123, Trento, Italy. E-mails: {rospocher, satonelli, serafini, pianta}@fbk.eu;Fondazione Bruno Kessler-irst, Via Sommarive 18 Povo, I-38123, Trento, Italy. E-mails: {rospocher, satonelli, serafini, pianta}@fbk.eu;Fondazione Bruno Kessler-irst, Via Sommarive 18 Povo, I-38123, Trento, Italy. E-mails: {rospocher, satonelli, serafini, pianta}@fbk.eu

  • Venue:
  • Applied Ontology - Ontologies and Terminologies: Continuum or Dichotomy?
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel system for corpus-based terminological evaluation of ontologies. Starting from the assumption that a domain of interest can be represented through a corpus of text documents, we first extract a list of domain-specific key-concepts from the corpus, rank them by relevance, and then apply various evaluation metrics to assess the terminological coverage of a domain ontology with respect to the list of key-concepts.Among the advantages of the proposed approach, we remark that the framework is highly automatizable, requiring little human intervention. The evaluation framework is made available online through a collaborative wiki-based system, which can be accessed by different users, from domain experts to knowledge engineers.We performed a comprehensive experimental analysis of our approach, showing that the proposed ontology metrics allow for assessing the terminological coverage of an ontology with respect to a given domain, and that our framework can be effectively applied to many evaluation-related scenarios.