The state of semantic technology today: overview of the first SEALS evaluation campaigns

Authors:
Lyndon Nixon;Mikalai Yatskevich;Raúl García-Castro;Cássia Trojahn dos Santos;Stuart Wrigley;Liliana Cabral
Affiliations:
STI International;University of Oxford;Universidad Politecnica de Madrid;INRIA;University of Sheffield;The Open University
Venue:
Proceedings of the 7th International Conference on Semantic Systems
Year:
2011

Citing 6
Cited 3

LUBM: A benchmark for OWL knowledge base systems

Web Semantics: Science, Services and Agents on the World Wide Web
Hybrid search: effectively combining keywords and semantic searches

ESWC'08 Proceedings of the 5th European semantic web conference on The semantic web: research and applications
Interoperability results for Semantic Web technologies using OWL as the interchange language

Web Semantics: Science, Services and Agents on the World Wide Web
Guidelines for benchmarking the performance of ontology management APIs

ISWC'05 Proceedings of the 4th international conference on The Semantic Web
Towards a complete OWL ontology benchmark

ESWC'06 Proceedings of the 3rd European conference on The Semantic Web: research and applications
FaCT++ description logic reasoner: system description

IJCAR'06 Proceedings of the Third international joint conference on Automated Reasoning

Infrastructure and workflow for the formal evaluation of semantic search technologies

Proceedings of the 2011 workshop on Data infrastructurEs for supporting information retrieval evaluation
Semantic evaluation at large scale (SEALS)

Proceedings of the 21st international conference companion on World Wide Web
Evaluating question answering over linked data

Web Semantics: Science, Services and Agents on the World Wide Web

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes the first five SEALS Evaluation Campaigns over the semantic technologies covered by the SEALS project (ontology engineering tools, ontology reasoning tools, ontology matching tools, semantic search tools, and semantic web service tools). It presents the evaluations and test data used in these campaigns and the tools that participated in them along with a comparative analysis of their results. It also presents some lessons learnt after the execution of the evaluation campaigns and draws some final conclusions.