RDFPeers: a scalable distributed RDF repository based on a structured peer-to-peer network
Proceedings of the 13th international conference on World Wide Web
MapReduce: simplified data processing on large clusters
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Parallel Inferencing for OWL Knowledge Bases
ICPP '08 Proceedings of the 2008 37th International Conference on Parallel Processing
RDFS Reasoning and Query Answering on Top of DHTs
ISWC '08 Proceedings of the 7th International Conference on The Semantic Web
SAOR: Authoritative Reasoning for the Web
ASWC '08 Proceedings of the 3rd Asian Semantic Web Conference on The Semantic Web
Scalable Distributed Ontology Reasoning Using DHT-Based Partitioning
ASWC '08 Proceedings of the 3rd Asian Semantic Web Conference on The Semantic Web
Scalable Semantics - The Silver Lining of Cloud Computing
ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
Marvin: Distributed reasoning over large-scale Semantic Web data
Web Semantics: Science, Services and Agents on the World Wide Web
Scalable Distributed Reasoning Using MapReduce
ISWC '09 Proceedings of the 8th International Semantic Web Conference
Parallel Materialization of the Finite RDFS Closure for Hundreds of Millions of Triples
ISWC '09 Proceedings of the 8th International Semantic Web Conference
Web Semantics: Science, Services and Agents on the World Wide Web
Mind the data skew: distributed inferencing by speeddating in elastic regions
Proceedings of the 19th international conference on World wide web
On triple dissemination, forward-chaining, and load balancing in DHT based RDF stores
DBISP2P'05/06 Proceedings of the 2005/2006 international conference on Databases, information systems, and peer-to-peer computing
Querying RDF streams with C-SPARQL
ACM SIGMOD Record
Semantic annotations for digital investigations
ESAIR '10 Proceedings of the third workshop on Exploiting semantic annotations in information retrieval
Invited paper: Scalable reduction of large datasets to interesting subsets
Web Semantics: Science, Services and Agents on the World Wide Web
SAOR: template rule optimisations for distributed reasoning over 1 billion linked data triples
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part I
Optimizing enterprise-scale OWL 2 RL reasoning in a relational database system
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part I
Signal/collect: graph algorithms for the (semantic) web
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part I
Scalable integration and processing of linked data
Proceedings of the 20th international conference companion on World wide web
A self-training approach for resolving object coreference on the semantic web
Proceedings of the 20th international conference on World wide web
Towards jungle computing with Ibis/Constellation
Proceedings of the 2011 workshop on Dynamic distributed data-intensive applications, programming abstractions, and systems
Clause-iteration with MapReduce to scalably query datagraphs in the SHARD graph-store
Proceedings of the fourth international workshop on Data-intensive distributed computing
High-performance computing applied to semantic databases
ESWC'11 Proceedings of the 8th extended semantic web conference on The semanic web: research and applications - Volume Part II
An intermediate algebra for optimizing RDF graph pattern matching on MapReduce
ESWC'11 Proceedings of the 8th extended semantic web conference on The semanic web: research and applications - Volume Part II
The design and implementation of minimal RDFS backward reasoning in 4store
ESWC'11 Proceedings of the 8th extended semantic web conference on The semanic web: research and applications - Volume Part II
Rule-based distributed and agent systems
RuleML'2011 Proceedings of the 5th international conference on Rule-based reasoning, programming, and applications
Introduction to linked data and its lifecycle on the web
RW'11 Proceedings of the 7th international conference on Reasoning web: semantic technologies for the web of data
Scalable OWL 2 reasoning for linked data
RW'11 Proceedings of the 7th international conference on Reasoning web: semantic technologies for the web of data
Context-dependent OWL reasoning in sindice - experiences and lessons learnt
RR'11 Proceedings of the 5th international conference on Web reasoning and rule systems
Integrating linked data through RDFS and OWL: some lessons learnt
RR'11 Proceedings of the 5th international conference on Web reasoning and rule systems
RR'11 Proceedings of the 5th international conference on Web reasoning and rule systems
Large scale fuzzy pD* reasoning using mapreduce
ISWC'11 Proceedings of the 10th international conference on The semantic web - Volume Part I
QueryPIE: backward reasoning for OWL horst over very large knowledge bases
ISWC'11 Proceedings of the 10th international conference on The semantic web - Volume Part I
Finding all justifications of OWL entailments using TMS and MapReduce
Proceedings of the 20th ACM international conference on Information and knowledge management
WebPIE: A Web-scale Parallel Inference Engine using MapReduce
Web Semantics: Science, Services and Agents on the World Wide Web
Web Semantics: Science, Services and Agents on the World Wide Web
An empirical survey of Linked Data conformance
Web Semantics: Science, Services and Agents on the World Wide Web
LIMES: a time-efficient approach for large-scale link discovery on the web of data
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
FactForge: a fast track to the web of data
Semantic Web
Parallel ABox reasoning of EL ontologies
JIST'11 Proceedings of the 2011 joint international conference on The Semantic Web
Scalable RDF data compression with MapReduce
Concurrency and Computation: Practice & Experience
Link discovery with guaranteed reduction ratio in affine spaces with minkowski measures
ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part I
Very large scale OWL reasoning through distributed computation
ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part II
Computing the stratified semantics of logic programs over big data through mass parallelization
RuleML'13 Proceedings of the 7th international conference on Theory, Practice, and Applications of Rules on the Web
Introduction to linked data and its lifecycle on the web
RW'13 Proceedings of the 9th international conference on Reasoning Web: semantic technologies for intelligent data access
Hi-index | 0.00 |
In previous work we have shown that the MapReduce framework for distributed computation can be deployed for highly scalable inference over RDF graphs under the RDF Schema semantics. Unfortunately, several key optimizations that enabled the scalable RDFS inference do not generalize to the richer OWL semantics. In this paper we analyze these problems, and we propose solutions to overcome them. Our solutions allow distributed computation of the closure of an RDF graph under the OWL Horst semantics. We demonstrate the WebPIE inference engine, built on top of the Hadoop platform and deployed on a compute cluster of 64 machines. We have evaluated our approach using some real-world datasets (UniProt and LDSR, about 0.9-1.5 billion triples) and a synthetic benchmark (LUBM, up to 100 billion triples). Results show that our implementation is scalable and vastly outperforms current systems when comparing supported language expressivity, maximum data size and inference speed.