The Globus Striped GridFTP Framework and Server

  • Authors:

  • William Allcock;John Bresnahan;Rajkumar Kettimuthu;Michael Link;Catalin Dumitrescu;Ioan Raicu;Ian Foster

  • Affiliations:

  • Argonne National Laboratory, IL;Argonne National Laboratory, IL;University of Chicago;University of Chicago;University of Chicago, Chicago, IL 60615, U.S.A.;University of Chicago, Chicago, IL 60615, U.S.A.;Argonne National Laboratory, Argonne, IL 60439, U.S.A. and University of Chicago, Chicago, IL 60615, U.S.A.

  • Venue:
  • SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
  • Year:
  • 2005

Quantified Score

Hi-index 0.02

Visualization

Abstract

The GridFTP extensions to the File Transfer Protocol define a general-purpose mechanism for secure, reliable, high-performance data movement. We report here on the Globus striped GridFTP framework, a set of client and server libraries designed to support the construction of data-intensive tools and applications. We describe the design of both this framework and a striped GridFTP server constructed within the framework. We show that this server is faster than other FTP servers in both single-process and striped configurations, achieving, for example, speeds of 27.3 Gbit/s memory-to-memory and 17 Gbit/s disk-to-disk over a 60 millisecond round trip time, 30 Gbit/s network. In another experiment, we show that the server can support 1800 concurrent clients without excessive load. We argue that this combination of performance and modular structure make the Globus GridFTP framework both a good foundation on which to build tools and applications, and a unique testbed for the study of innovative data management techniques and network protocols.