A vision for management of complex models
ACM SIGMOD Record
Data integration: a theoretical perspective
Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Generic Schema Matching with Cupid
Proceedings of the 27th International Conference on Very Large Data Bases
Comparison of Schema Matching Evaluations
Revised Papers from the NODe 2002 Web and Database-Related Workshops on Web, Web-Services, and Database Systems
Ontology mapping: the state of the art
The Knowledge Engineering Review
iMAP: discovering complex semantic matches between database schemas
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Why Evaluate Ontology Technologies? Because It Works!
IEEE Intelligent Systems
Schema and ontology matching with COMA++
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Ontology Matching
XBenchMatch: a benchmark for XML schema matching tools
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Ontologies and the semantic web
Communications of the ACM - Surviving the data deluge
STBenchmark: towards a benchmark for mapping systems
Proceedings of the VLDB Endowment
Comparing and evaluating mapping systems with STBenchmark
Proceedings of the VLDB Endowment
Semantic Web Services Challenge: Results from the First Year
Semantic Web Services Challenge: Results from the First Year
OTM '08 Proceedings of the OTM 2008 Confederated International Conferences, CoopIS, DOA, GADA, IS, and ODBASE 2008. Part I on On the Move to Meaningful Internet Systems:
Ten Challenges for Ontology Matching
OTM '08 Proceedings of the OTM 2008 Confederated International Conferences, CoopIS, DOA, GADA, IS, and ODBASE 2008. Part II on On the Move to Meaningful Internet Systems
The Harmony Integration Workbench
Journal on Data Semantics XI
Generic schema mappings for composition and query answering
Data & Knowledge Engineering
SP^2Bench: A SPARQL Performance Benchmark
ICDE '09 Proceedings of the 2009 IEEE International Conference on Data Engineering
A large dataset for the evaluation of ontology matching
The Knowledge Engineering Review
Who the Heck Is the Father of Bob?
ESWC 2009 Heraklion Proceedings of the 6th European Semantic Web Conference on The Semantic Web: Research and Applications
Semantic precision and recall for ontology alignment evaluation
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Ontology matching with semantic verification
Web Semantics: Science, Services and Agents on the World Wide Web
Proceedings of the 18th ACM conference on Information and knowledge management
Effective query rewriting with ontologies over DBoxes
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
AgreementMaker: efficient matching for large real-world schemas and ontologies
Proceedings of the VLDB Endowment
LUBM: A benchmark for OWL knowledge base systems
Web Semantics: Science, Services and Agents on the World Wide Web
GeRoMe: a generic role based metamodel for model management
Journal on data semantics VIII
Sindice.com: weaving the open linked data
ISWC'07/ASWC'07 Proceedings of the 6th international The semantic web and 2nd Asian conference on Asian semantic web conference
Two variations on ontology alignment evaluation: methodological issues
ESWC'08 Proceedings of the 5th European semantic web conference on The semantic web: research and applications
Putting ontology alignment in context: usage scenarios, deployment and evaluation in a library case
ESWC'08 Proceedings of the 5th European semantic web conference on The semantic web: research and applications
Semantic matching: algorithms and implementation
Journal on data semantics IX
OpenII: an open source information integration toolkit
Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Save up to 99% of your time in mapping validation
OTM'10 Proceedings of the 2010 international conference on On the move to meaningful internet systems: Part II
Measuring the quality of an integrated schema
ER'10 Proceedings of the 29th international conference on Conceptual modeling
Semantic Web
A method to combine linguistic ontology-mapping techniques
ISWC'05 Proceedings of the 4th international conference on The Semantic Web
Towards a complete OWL ontology benchmark
ESWC'06 Proceedings of the 3rd European conference on The Semantic Web: research and applications
OTM'05 Proceedings of the 2005 Confederated international conference on On the Move to Meaningful Internet Systems - Volume >Part I
Three semantics for distributed systems and their relations with alignment composition
ISWC'06 Proceedings of the 5th international conference on The Semantic Web
A survey of schema-based matching approaches
Journal on Data Semantics IV
LogMap: logic-based and scalable ontology matching
ISWC'11 Proceedings of the 10th international conference on The semantic web - Volume Part I
When conceptual model meets grammar: A dual approach to XML data modeling
Data & Knowledge Engineering
LogMap 2.0: towards logic-based, scalable and interactive ontology matching
Proceedings of the 4th International Workshop on Semantic Web Applications and Tools for the Life Sciences
SWET-QUM: a quality in use extension model for semantic web exploration tools
Proceedings of the 13th International Conference on Interacción Persona-Ordenador
TrustMe, i got what you mean!: a trust-based semantic p2p bookmarking system
EKAW'12 Proceedings of the 18th international conference on Knowledge Engineering and Knowledge Management
Description logic knowledge base exchange
RR'12 Proceedings of the 6th international conference on Web Reasoning and Rule Systems
Ontology alignment for semantic data integration through foundational ontologies
ER'12 Proceedings of the 2012 international conference on Advances in Conceptual Modeling
Towards big linked data: a large-scale, distributed semantic data storage
Proceedings of the 14th International Conference on Information Integration and Web-based Applications & Services
Ontology relation alignment based on attribute semantics
ICCCI'12 Proceedings of the 4th international conference on Computational Collective Intelligence: technologies and applications - Volume Part II
Grounding linked open data in wordnet: the case of the OSM semantic network
W2GIS'13 Proceedings of the 12th international conference on Web and Wireless Geographical Information Systems
Ontology alignment using artificial neural network for large-scale ontologies
International Journal of Metadata, Semantics and Ontologies
KnowRob: A knowledge processing infrastructure for cognition-enabled robots
International Journal of Robotics Research
Discovering meaning on the go in large heterogenous data
Artificial Intelligence Review
Semantic Interoperability on the Internet of Things: The Semantic Smart Gateway Framework
International Journal of Distributed Systems and Technologies
Using MathML to represent units of measurement for improved ontology alignment
CICM'13 Proceedings of the 2013 international conference on Intelligent Computer Mathematics
A Semantic Service-Oriented Platform for Integrated and Personalised Access to Sustainable Projects
Proceedings of International Conference on Information Integration and Web-based Applications & Services
Hi-index | 0.00 |
In the area of semantic technologies, benchmarking and systematic evaluation is not yet as established as in other areas of computer science, e.g., information retrieval. In spite of successful attempts, more effort and experience are required in order to achieve such a level of maturity. In this paper, we report results and lessons learned from the Ontology Alignment Evaluation Initiative (OAEI), a benchmarking initiative for ontology matching. The goal of this work is twofold: on the one hand, we document the state of the art in evaluating ontology matching methods and provide potential participants of the initiative with a better understanding of the design and the underlying principles of the OAEI campaigns. On the other hand, we report experiences gained in this particular area of semantic technologies to potential developers of benchmarking for other kinds of systems. For this purpose, we describe the evaluation design used in the OAEI campaigns in terms of datasets, evaluation criteria and workflows, provide a global view on the results of the campaigns carried out from 2005 to 2010 and discuss upcoming trends, both specific to ontology matching and generally relevant for the evaluation of semantic technologies. Finally, we argue that there is a need for a further automation of benchmarking to shorten the feedback cycle for tool developers.