Distributed computation on dynamo-style distributed storage: riak pipe

Authors:
Bryan Fink
Affiliations:
Basho Technologies, Cambridge, MA, USA
Venue:
Proceedings of the eleventh ACM SIGPLAN workshop on Erlang workshop
Year:
2012

Citing 3
Cited 0

SEDA: an architecture for well-conditioned, scalable internet services

SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
MapReduce: simplified data processing on large clusters

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Dynamo: amazon's highly available key-value store

Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles

Quantified Score

Hi-index	0.00

Visualization

Abstract

The Dynamo model, as described by Amazon in 2007, has become a popular concept in the development of distributed storage systems. The model accounts for only CRUD operations, however. This paper describes a system called Riak Pipe that enables the use of generic functions in place of CRUD operations. This allows Dynamo-model users to exploit other resources, such as CPU time, available in their cluster, as well as to gain the efficiencies offered by data-local processing.