Distributed Systems: Principles and Paradigms (2nd Edition)
Distributed Systems: Principles and Paradigms (2nd Edition)
Dryad: distributed data-parallel programs from sequential building blocks
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Hi-index | 0.00 |
We describe in this paper a Distributed Chunk-based Flow Management System (DCFMS), which is part of a distributed simulation system (framework), under development. It illustrates a parallel dataflow style of programming, in which dataflow handling is separated into a standalone module whose main role is to acquire, store and provide the data required by the application's processes in the most efficient way. Of the existing systems, the BitTorrent Protocol and Apache Hadoop - HDFS are identified as being the closest to our approach.