Towards a complete OWL ontology benchmark

  • Authors:

  • Li Ma;Yang Yang;Zhaoming Qiu;Guotong Xie;Yue Pan;Shengping Liu

  • Affiliations:

  • IBM China Research Laboratory, Beijing, P.R. China;IBM China Research Laboratory, Beijing, P.R. China;IBM China Research Laboratory, Beijing, P.R. China;IBM China Research Laboratory, Beijing, P.R. China;IBM China Research Laboratory, Beijing, P.R. China;IBM China Research Laboratory, Beijing, P.R. China

  • Venue:
  • ESWC'06 Proceedings of the 3rd European conference on The Semantic Web: research and applications
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Aiming to build a complete benchmark for better evaluation of existing ontology systems, we extend the well-known Lehigh University Benchmark in terms of inference and scalability testing. The extended benchmark, named University Ontology Benchmark (UOBM), includes both OWL Lite and OWL DL ontologies covering a complete set of OWL Lite and DL constructs, respectively. We also add necessary properties to construct effective instance links and improve instance generation methods to make the scalability testing more convincing. Several well-known ontology systems are evaluated on the extended benchmark and detailed discussions on both existing ontology systems and future benchmark development are presented.