A reliable and scalable striping protocol
Conference proceedings on Applications, technologies, architectures, and protocols for computer communications
A Slowdown Model for Applications Executing on Time-Shared Clusters of Workstations
IEEE Transactions on Parallel and Distributed Systems
Message-Passing Performance of Parallel Computers
Euro-Par '97 Proceedings of the Third International Euro-Par Conference on Parallel Processing
Selected Results from the ParkBench Benchmark
Euro-Par '96 Proceedings of the Second International Euro-Par Conference on Parallel Processing-Volume II
Performance Properties of Combined Heterogeneous Networks
IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Scalable Bulk Data Transfer in Wide Area Networks
International Journal of High Performance Computing Applications
Striping within the network subsystem
IEEE Network: The Magazine of Global Internetworking
Self-configured multiple-network-interface socket
Journal of Network and Computer Applications
Employing transport layer multi-railing in cluster networks
Journal of Parallel and Distributed Computing
Using CMT in SCTP-based MPI to exploit multiple interfaces in cluster nodes
PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Hi-index | 0.00 |
This paper introduces a high-performance middleware-level message striping approach to increase communication bandwidth for data transfer in heterogeneous clusters equipped with multiple networks. In this scheme, concurrency is used for the striping process. The proposed striping approach is designed to work at the middleware-level, between the distributed applications and the reliable transport protocols such as TCP. The middleware-level striping approach provides flexible, scalable, and hardware-, network-, and operating systems-independent communication bandwidth solution. In addition, techniques to enhance the performance of this approach over multiple networks are introduced. The proposed techniques, which minimize synchronization contention and eliminate the striping sequence header, rely on the features of a reliable transport protocol such as TCP to reduce some of the concurrent striping overhead. The techniques have been implemented and evaluated on a real cluster with multiple networks and the results show significant performance gains for data transfer over existing approaches.