Partition Cast - Modelling and Optimizing the Distribution of Large Data Sets in PC Clusters (Distinguished Paper)

Authors:
Felix Rauch;Christian Kurmann;Thomas Stricker
Affiliations:
-;-;-
Venue:
Euro-Par '00 Proceedings from the 6th International Euro-Par Conference on Parallel Processing
Year:
2000

Citing 6
Cited 0

A reliable multicast framework for light-weight sessions and application level framing

SIGCOMM '95 Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication
Optimizing memory system performance for communication in parallel computers

ISCA '95 Proceedings of the 22nd annual international symposium on Computer architecture
Logical vs. physical file system backup

OSDI '99 Proceedings of the third symposium on Operating systems design and implementation
Gigabit Ethernet: Technology and Applications for High-Speed LANs

Gigabit Ethernet: Technology and Applications for High-Speed LANs
Myrinet: A Gigabit-per-Second Local Area Network

IEEE Micro
Why use a fishing line when you have a net? an adaptive multicast data distribution protocol

ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

Multicasting large amounts of data efficiently to all nodes of a PC cluster is an important operation. In the form of a partition cast it can be used to replicate entire software installations by cloning. Optimizing a partition cast for a given cluster of PCs reveals some interesting architectural tradeoffs, since the fastest solution does not only depend on the network speed and topology, but remains highly sensitive to other resources like the disk speed, the memory system performance and the processing power in the participating nodes. We present an analytical model that guides an implementation towards an optimal configuration for any given PC cluster. The model is validated by measurements on our cluster using Gigabit- and Fast Ethernet links. The resulting simple software tool, Dolly, can replicate an entire 2 GByteWindows NT image onto 24 machines in less than 5 minutes.