RDFPeers: a scalable distributed RDF repository based on a structured peer-to-peer network
Proceedings of the 13th international conference on World Wide Web
MapReduce: simplified data processing on large clusters
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Parallel Inferencing for OWL Knowledge Bases
ICPP '08 Proceedings of the 2008 37th International Conference on Parallel Processing
IEEE Intelligent Systems
RDFS Reasoning and Query Answering on Top of DHTs
ISWC '08 Proceedings of the 7th International Conference on The Semantic Web
SAOR: Authoritative Reasoning for the Web
ASWC '08 Proceedings of the 3rd Asian Semantic Web Conference on The Semantic Web
Scalable Distributed Ontology Reasoning Using DHT-Based Partitioning
ASWC '08 Proceedings of the 3rd Asian Semantic Web Conference on The Semantic Web
Practical partition-based theorem proving for large knowledge bases
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Web Semantics: Science, Services and Agents on the World Wide Web
LUBM: A benchmark for OWL knowledge base systems
Web Semantics: Science, Services and Agents on the World Wide Web
On triple dissemination, forward-chaining, and load balancing in DHT based RDF stores
DBISP2P'05/06 Proceedings of the 2005/2006 international conference on Databases, information systems, and peer-to-peer computing
OWLIM – a pragmatic semantic repository for OWL
WISE'05 Proceedings of the 2005 international conference on Web Information Systems Engineering
Minerva: a scalable OWL ontology storage and inference system
ASWC'06 Proceedings of the First Asian conference on The Semantic Web
A RESTful messaging system for asynchronous distributed processing
Proceedings of the First International Workshop on RESTful Design
Massive Semantic Web data compression with MapReduce
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Parallel TBox Classification in Description Logics --First Experimental Results
Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Invited paper: Scalable reduction of large datasets to interesting subsets
Web Semantics: Science, Services and Agents on the World Wide Web
SAOR: template rule optimisations for distributed reasoning over 1 billion linked data triples
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part I
Optimize first, buy later: analyzing metrics to ramp-up very large knowledge bases
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part I
Signal/collect: graph algorithms for the (semantic) web
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part I
ISReal: an open platform for semantic-based 3D simulations in the 3D internet
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part II
Programming Support Innovations for Emerging Distributed Applications
Scalable integration and processing of linked data
Proceedings of the 20th international conference companion on World wide web
RDF packages: a scheme for efficient reasoning and querying over large-scale RDF data
Proceedings of the 12th International Conference on Information Integration and Web-based Applications & Services
Scalable clone detection using description logic
Proceedings of the 5th International Workshop on Software Clones
Large knowledge collider: a service-oriented platform for large-scale semantic reasoning
Proceedings of the International Conference on Web Intelligence, Mining and Semantics
Clause-iteration with MapReduce to scalably query datagraphs in the SHARD graph-store
Proceedings of the fourth international workshop on Data-intensive distributed computing
High-performance computing applied to semantic databases
ESWC'11 Proceedings of the 8th extended semantic web conference on The semanic web: research and applications - Volume Part II
An intermediate algebra for optimizing RDF graph pattern matching on MapReduce
ESWC'11 Proceedings of the 8th extended semantic web conference on The semanic web: research and applications - Volume Part II
The design and implementation of minimal RDFS backward reasoning in 4store
ESWC'11 Proceedings of the 8th extended semantic web conference on The semanic web: research and applications - Volume Part II
Rule-based distributed and agent systems
RuleML'2011 Proceedings of the 5th international conference on Rule-based reasoning, programming, and applications
Scalable OWL 2 reasoning for linked data
RW'11 Proceedings of the 7th international conference on Reasoning web: semantic technologies for the web of data
Context-dependent OWL reasoning in sindice - experiences and lessons learnt
RR'11 Proceedings of the 5th international conference on Web reasoning and rule systems
Integrating linked data through RDFS and OWL: some lessons learnt
RR'11 Proceedings of the 5th international conference on Web reasoning and rule systems
RR'11 Proceedings of the 5th international conference on Web reasoning and rule systems
Concurrent classification of EL ontologies
ISWC'11 Proceedings of the 10th international conference on The semantic web - Volume Part I
Large scale fuzzy pD* reasoning using mapreduce
ISWC'11 Proceedings of the 10th international conference on The semantic web - Volume Part I
QueryPIE: backward reasoning for OWL horst over very large knowledge bases
ISWC'11 Proceedings of the 10th international conference on The semantic web - Volume Part I
Practical RDF schema reasoning with annotated semantic web data
ISWC'11 Proceedings of the 10th international conference on The semantic web - Volume Part I
Efficient RDFS entailment in external memory
OTM'11 Proceedings of the 2011th Confederated international conference on On the move to meaningful internet systems
Searching and browsing Linked Data with SWSE: The Semantic Web Search Engine
Web Semantics: Science, Services and Agents on the World Wide Web
Editorial: Web-scale semantic information processing
Web Semantics: Science, Services and Agents on the World Wide Web
WebPIE: A Web-scale Parallel Inference Engine using MapReduce
Web Semantics: Science, Services and Agents on the World Wide Web
Web Semantics: Science, Services and Agents on the World Wide Web
Distributed island-based query answering for expressive ontologies
GPC'10 Proceedings of the 5th international conference on Advances in Grid and Pervasive Computing
Scalable and parallel reasoning in the semantic web
ESWC'10 Proceedings of the 7th international conference on The Semantic Web: research and Applications - Volume Part II
OWL reasoning with WebPIE: calculating the closure of 100 billion triples
ESWC'10 Proceedings of the 7th international conference on The Semantic Web: research and Applications - Volume Part I
Efficient SPARQL query processing in mapreduce through data partitioning and indexing
APWeb'12 Proceedings of the 14th Asia-Pacific international conference on Web Technologies and Applications
An empirical survey of Linked Data conformance
Web Semantics: Science, Services and Agents on the World Wide Web
P2P approach to knowledge-based dynamic virtual organizations inception and management
PPAM'11 Proceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part II
Towards efficient join processing over large RDF graph using mapreduce
SSDBM'12 Proceedings of the 24th international conference on Scientific and Statistical Database Management
Scalable peer-to-peer-based RDF management
Proceedings of the 8th International Conference on Semantic Systems
Parallel ABox reasoning of EL ontologies
JIST'11 Proceedings of the 2011 joint international conference on The Semantic Web
A hierarchical back-end architecture for smartphone sensing
Proceedings of the 2012 ACM Research in Applied Computation Symposium
Toward scalable reasoning over annotated RDF data using mapreduce
RR'12 Proceedings of the 6th international conference on Web Reasoning and Rule Systems
Scalable RDF data compression with MapReduce
Concurrency and Computation: Practice & Experience
RDFS reasoning on massively parallel hardware
ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part I
Very large scale OWL reasoning through distributed computation
ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part II
Distributed reasoning on semantic data streams
ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part II
Overcoming limitations of term-based partitioning for distributed RDFS reasoning
Proceedings of the Fifth Workshop on Semantic Web Information Management
Database research challenges and opportunities of big graph data
BNCOD'13 Proceedings of the 29th British National conference on Big Data
Computing the stratified semantics of logic programs over big data through mass parallelization
RuleML'13 Proceedings of the 7th international conference on Theory, Practice, and Applications of Rules on the Web
RDFS and OWL reasoning for linked data
RW'13 Proceedings of the 9th international conference on Reasoning Web: semantic technologies for intelligent data access
| Hi-index | 0.00 |
We address the problem of scalable distributed reasoning, proposing a technique for materialising the closure of an RDF graph based on MapReduce. We have implemented our approach on top of Hadoop and deployed it on a compute cluster of up to 64 commodity machines. We show that a naive implementation on top of MapReduce is straightforward but performs badly and we present several non-trivial optimisations. Our algorithm is scalable and allows us to compute the RDFS closure of 865M triples from the Web (producing 30B triples) in less than two hours, faster than any other published approach.