High speed bulk data transfer using the SSH protocol

Authors:
Chris Rapier;Benjamin Bennett
Affiliations:
Pittsburgh Supercomputing Center, Pittsburgh, PA;Pittsburgh Supercomputing Center, Pittsburgh, PA
Venue:
Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities
Year:
2008

Citing 4
Cited 7

TCP/IP illustrated (vol. 1): the protocols

TCP/IP illustrated (vol. 1): the protocols
Automatic TCP buffer tuning

Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication
Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing

MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
glogin - A Multifunctional, Interactive Tunnel into the Grid

GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing

DTPD: Data Transfer Tool Performance Diagnosis System in High Speed Networks

APNOMS '08 Proceedings of the 11th Asia-Pacific Symposium on Network Operations and Management: Challenges for Next Generation Network Operations and Service Management
GMount: An Ad Hoc and Locality-Aware Distributed File System by Using SSH and FUSE

CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
GMount: Build your grid file system on the fly

GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
High performance multi-node file copies and checksums for clustered file systems

LISA'10 Proceedings of the 24th international conference on Large installation system administration
DefenestraTor: throwing out windows in Tor

PETS'11 Proceedings of the 11th international conference on Privacy enhancing technologies
Local system security via SSHD instrumentation

LISA'11 Proceedings of the 25th international conference on Large Installation System Administration
High performance reliable file transfers using automatic many-to-many parallelization

Euro-Par'12 Proceedings of the 18th international conference on Parallel processing workshops

Quantified Score

Hi-index	0.01

Visualization

Abstract

SSH is a highly successful multipurpose protocol used for both interactive shells and transport layer mechanisms. However, a design choice in most implementations of SSH reduces its functionality as bulk data transport tool in high performance network environments. This paper will discuss the nature of this limitation, the functional barriers it imposes, a method by which it can be remedied, and introduces a high performance implementation based on the industry standard, OpenSSH. Additionally, the authors will introduce a method by which performance on multi-core systems is improved through the use of cipher multi-threading.