A case for redundant arrays of inexpensive disks (RAID)
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
Congestion control for high bandwidth-delay product networks
Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications
Reliable Blast UDP: Predictable High Performance Bulk Data Transfer
CLUSTER '02 Proceedings of the IEEE International Conference on Cluster Computing
Scalable TCP: improving performance in highspeed wide area networks
ACM SIGCOMM Computer Communication Review
The Globus eXtensible Input/Output System (XIO): A Protocol Independent IO System for the Grid
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 4 - Volume 05
The Anatomy of the Grid: Enabling Scalable Virtual Organizations
International Journal of High Performance Computing Applications
Simple Available Bandwidth Utilization Library for High-Speed Wide Area Networks
The Journal of Supercomputing
The Globus Striped GridFTP Framework and Server
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
FAST TCP: motivation, architecture, algorithms, performance
IEEE/ACM Transactions on Networking (TON)
UDT: UDP-based data transfer for high-speed wide area networks
Computer Networks: The International Journal of Computer and Telecommunications Networking
XTP as a transport protocol for distributed parallel processing
HSNS'94 Proceedings of the High-Speed Networking Symposium on USENIX 1994 High-Speed Networking Symposium
Designing NFS with RDMA for Security, Performance and Scalability
ICPP '07 Proceedings of the 2007 International Conference on Parallel Processing
CUBIC: a new TCP-friendly high-speed TCP variant
ACM SIGOPS Operating Systems Review - Research and developments in the Linux kernel
Experimental evaluation of infiniband transport over local- and wide-area networks
SpringSim '07 Proceedings of the 2007 spring simulation multiconference - Volume 2
Wide-area performance profiling of 10GigE and InfiniBand technologies
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Performance of HPC Middleware over InfiniBand WAN
ICPP '08 Proceedings of the 2008 37th International Conference on Parallel Processing
Designing Efficient FTP Mechanisms for High Performance Data-Transfer over InfiniBand
ICPP '09 Proceedings of the 2009 International Conference on Parallel Processing
Interactive 3D rendering to assist the processing of distributed medical data
Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia
Globus XIO pipe open driver: enabling GridFTP to leverage standard Unix tools
Proceedings of the 2011 TeraGrid Conference: Extreme Digital Discovery
RXIO: Design and implementation of high performance RDMA-capable GridFTP
Computers and Electrical Engineering
Protocols for wide-area data-intensive applications: design and performance issues
SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Design and performance evaluation of NUMA-aware RDMA-based end-to-end data transfer systems
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
| Hi-index | 0.00 |
GridFTP, designed using the Globus XIO framework, is one of the most popular methods in use to perform data transfers in the grid environment. But the performance of GridFTP in WAN is limited by the relatively low communication bandwidth offered by the existing network protocols. On the other hand, modern interconnects such as InfiniBand, with many advanced communication features like zero-copy protocol and RDMA operations, can greatly improve communication efficiency. In this paper, we take on the challenge of combining the ease of use of the Globus XIO framework and the high performance achieved through InfiniBand communication, thereby natively sup-porting GridFTP over InfiniBand based networks. The Advanced Data Transfer Service (ADTS), designed in our previous work, provides the low level InfiniBand support to the Globus XIO layer. We introduce the concepts of I/Ostaging in the Globus XIO ADTS driver to achieve efficient disk based data transfers. We evaluate our designs in both LAN and WAN environments using micro benchmarks as well as communication traces from several real world applications. We also provide insights into the communication performance with some in-depth analysis. Our experimental evaluation shows a performance improvement of up to100% for ADTS based data transfers as opposed to TCP or UDP based ones in LAN and high delay WAN scenarios.