The Composite Endpoint Protocol (CEP): scalable endpoints for terabit flows

Authors:
E. Weigle;A. A. Chien
Affiliations:
Dept. of Comput. Sci. & Eng., California Univ., San Diego, La Jolla, CA, USA;Dept. of Comput. Sci. & Eng., California Univ., San Diego, La Jolla, CA, USA
Venue:
CCGRID '05 Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2 - Volume 02
Year:
2005

Citing 0
Cited 6

The Globus Striped GridFTP Framework and Server

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Coupling prefix caching and collective downloads for remote dataset access

Proceedings of the 20th annual international conference on Supercomputing
Partial content distribution on high performance networks

Proceedings of the 16th international symposium on High performance distributed computing
A configurable and extensible transport protocol

IEEE/ACM Transactions on Networking (TON)
Integrated resource management for lambda-grids: The Distributed Virtual Computer (DVC)

Future Generation Computer Systems
Optimizing Data Management in Grid Environments

OTM '09 Proceedings of the Confederated International Conferences, CoopIS, DOA, IS, and ODBASE 2009 on On the Move to Meaningful Internet Systems: Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

We introduce the Composite Endpoint Protocol (CEP), which efficiently composes a set of transmission elements to support high speed flows which exceed the capabilities of a single computer. CEP's unique capabilities include: (1) allowing multiple processes (a composite endpoint) to take part in a single logical connection, (2) providing a simple, flexible interface to describe data layouts and composite endpoint communication to user programs, (3) providing efficient transfer scheduling which coordinates heterogeneous nodes to achieve good composite performance, and (4) a scalable architecture which supports large numbers of participants in a composite endpoint. We describe the design of CEP, an initial implementation, and an empirical evaluation exhibiting the above capabilities. We have achieved speeds over 32 Gbps using commodity cluster hardware with linear scalability performance 7x naive approaches, and low overhead.