Space/time trade-offs in hash coding with allowable errors
Communications of the ACM
Chord: A scalable peer-to-peer lookup service for internet applications
Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
RDFPeers: a scalable distributed RDF repository based on a structured peer-to-peer network
Proceedings of the 13th international conference on World Wide Web
Ibis: a flexible and efficient Java-based Grid programming environment: Research Articles
Concurrency and Computation: Practice & Experience - 2002 ACM Java Grande–ISCOPE Conference Part II
Simple Efficient Load-Balancing Algorithms for Peer-to-Peer Systems
Theory of Computing Systems
MapReduce: simplified data processing on large clusters
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Proceedings of the 17th international conference on World Wide Web
Towards LarKC: A Platform for Web-Scale Reasoning
ICSC '08 Proceedings of the 2008 IEEE International Conference on Semantic Computing
Sindice.com: a document-oriented lookup index for open linked data
International Journal of Metadata, Semantics and Ontologies
On triple dissemination, forward-chaining, and load balancing in DHT based RDF stores
DBISP2P'05/06 Proceedings of the 2005/2006 international conference on Databases, information systems, and peer-to-peer computing
Querying distributed RDF data sources with SPARQL
ESWC'08 Proceedings of the 5th European semantic web conference on The semantic web: research and applications
DRAGO: distributed reasoning architecture for the semantic web
ESWC'05 Proceedings of the Second European conference on The Semantic Web: research and Applications
A survey and comparison of peer-to-peer overlay network schemes
IEEE Communications Surveys & Tutorials
The Quest for Parallel Reasoning on the Semantic Web
AMT '09 Proceedings of the 5th International Conference on Active Media Technology
Mind the data skew: distributed inferencing by speeddating in elastic regions
Proceedings of the 19th international conference on World wide web
Technically approaching the semantic web bottleneck
International Journal of Web Engineering and Technology
Invited paper: Scalable reduction of large datasets to interesting subsets
Web Semantics: Science, Services and Agents on the World Wide Web
Signal/collect: graph algorithms for the (semantic) web
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part I
On enhancing scalability for distributed RDF/S stores
Proceedings of the 14th International Conference on Extending Database Technology
Rule-based distributed and agent systems
RuleML'2011 Proceedings of the 5th international conference on Rule-based reasoning, programming, and applications
Efficient RDFS entailment in external memory
OTM'11 Proceedings of the 2011th Confederated international conference on On the move to meaningful internet systems
Searching and browsing Linked Data with SWSE: The Semantic Web Search Engine
Web Semantics: Science, Services and Agents on the World Wide Web
WebPIE: A Web-scale Parallel Inference Engine using MapReduce
Web Semantics: Science, Services and Agents on the World Wide Web
Web Semantics: Science, Services and Agents on the World Wide Web
OWL reasoning with WebPIE: calculating the closure of 100 billion triples
ESWC'10 Proceedings of the 7th international conference on The Semantic Web: research and Applications - Volume Part I
Parallel ABox reasoning of EL ontologies
JIST'11 Proceedings of the 2011 joint international conference on The Semantic Web
Very large scale OWL reasoning through distributed computation
ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part II
Towards big linked data: a large-scale, distributed semantic data storage
Proceedings of the 14th International Conference on Information Integration and Web-based Applications & Services
Coupling semantics with things in the internet of the future: a survey
International Journal of Metadata, Semantics and Ontologies
Semantics for the Internet of Things: Early Progress and Back to the Future
International Journal on Semantic Web & Information Systems
Computing the stratified semantics of logic programs over big data through mass parallelization
RuleML'13 Proceedings of the 7th international conference on Theory, Practice, and Applications of Rules on the Web
Hi-index | 0.00 |
Many Semantic Web problems are difficult to solve through common divide-and-conquer strategies, since they are hard to partition. We present Marvin, a parallel and distributed platform for processing large amounts of RDF data, on a network of loosely coupled peers. We present our divide-conquer-swap strategy and show that this model converges towards completeness. Within this strategy, we address the problem of making distributed reasoning scalable and load-balanced. We present SpeedDate, a routing strategy that combines data clustering with random exchanges. The random exchanges ensure load balancing, while the data clustering attempts to maximise efficiency. SpeedDate is compared against random and deterministic (DHT-like) approaches, on performance and load-balancing. We simulate parameters such as system size, data distribution, churn rate, and network topology. The results indicate that SpeedDate is near-optimally balanced, performs in the same order of magnitude as a DHT-like approach, and has an average throughput per node that scales with i for i items in the system. We evaluate our overall Marvin system for performance, scalability, load balancing and efficiency.