Mining association rules between sets of items in large databases
SIGMOD '93 Proceedings of the 1993 ACM SIGMOD international conference on Management of data
A retrospective on the Wisconsin Benchmark
Readings in database systems (2nd ed.)
An engineering database benchmark
Readings in database systems (2nd ed.)
The Sequoia 2000 storage benchmark
Readings in database systems (2nd ed.)
On power-law relationships of the Internet topology
Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication
Ontology Learning for the Semantic Web
IEEE Intelligent Systems
Benchmarking Database Systems A Systematic Approach
VLDB '83 Proceedings of the 9th International Conference on Very Large Data Bases
Sesame: A Generic Architecture for Storing and Querying RDF and RDF Schema
ISWC '02 Proceedings of the First International Semantic Web Conference on The Semantic Web
DAMLJessKB: A Tool for Reasoning with the Semantic Web
IEEE Intelligent Systems
LUBM: A benchmark for OWL knowledge base systems
Web Semantics: Science, Services and Agents on the World Wide Web
A Requirements Driven Framework for Benchmarking Semantic Web Knowledge Base Systems
IEEE Transactions on Knowledge and Data Engineering
A comparison of ontology reasoning systems using query sequences
Proceedings of the 2nd international conference on Ubiquitous information management and communication
Large scale knowledge base systems: an empirical evaluation perspective
AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Optimize first, buy later: analyzing metrics to ramp-up very large knowledge bases
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part I
Using ontology databases for scalable query answering, inconsistency detection, and data integration
Journal of Intelligent Information Systems
A survey of the web ontology landscape
ISWC'06 Proceedings of the 5th international conference on The Semantic Web
CooL-AgentSpeak: Endowing AgentSpeak-DL agents with plan exchange and ontology services
Web Intelligence and Agent Systems
CooL-AgentSpeak: Endowing AgentSpeak-DL agents with plan exchange and ontology services
Web Intelligence and Agent Systems
Hi-index | 0.00 |
We present a method for rapid development of benchmarks for Semantic Web knowledge base systems. At the core, we have a synthetic data generation approach for OWL that is scalable and models the real world data. The data-generation algorithm learns from real domain documents and generates benchmark data based on the extracted properties relevant for benchmarking. We believe that this is important because relative performance of systems will vary depending on the structure of the ontology and data used. However, due to the novelty of the Semantic Web, we rarely have sufficient data for benchmarking. Our approach helps overcome the problem of having insufficient real world data for benchmarking and allows us to develop benchmarks for a variety of domains and applications in a very time efficient manner. Based on our method, we have created a new Lehigh BibTeX Benchmark and conducted an experiment on four Semantic Web knowledge base systems. We have verified our hypothesis about the need for representative data by comparing the experimental result to that of our previous Lehigh University Benchmark. The difference in both experiments has demonstrated the influence of ontology and data on the capability and performance of the systems and thus the need of using a representative benchmark for the intended application of the systems.