On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems

Authors:
Elie Krevat;Vijay Vasudevan;Amar Phanishayee;David G. Andersen;Gregory R. Ganger;Garth A. Gibson;Srinivasan Seshan
Affiliations:
Carnegie Mellon University;Carnegie Mellon University;Carnegie Mellon University;Carnegie Mellon University;Carnegie Mellon University;Carnegie Mellon University;Carnegie Mellon University
Venue:
PDSW '07 Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07
Year:
2007

Citing 8
Cited 7

Fat-trees: universal networks for hardware-efficient supercomputing

IEEE Transactions on Computers
A cost-effective, high-bandwidth storage architecture

Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
GPFS: A Shared-Disk File System for Large Computing Clusters

FAST '02 Proceedings of the Conference on File and Storage Technologies
On estimating end-to-end network path properties

ACM SIGCOMM Computer Communication Review - Workshop on data communication in Latin America and the Caribbean
Fail-Stutter Fault Tolerance

HOTOS '01 Proceedings of the Eighth Workshop on Hot Topics in Operating Systems
The Google file system

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
The Panasas ActiveScale Storage Cluster: Delivering Scalable High Bandwidth Storage

Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Ursa minor: versatile cluster-based storage

FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4

Internet-in-a-Box: emulating datacenter network architectures using FPGAs

Proceedings of the 46th Annual Design Automation Conference
Sources of instability in data center multicast

Proceedings of the 4th International Workshop on Large Scale Distributed Systems and Middleware
Improve throughput of storage cluster interconnected with a TCP/IP network using intelligent server grouping

NPC'10 Proceedings of the 2010 IFIP international conference on Network and parallel computing
ICTCP: Incast Congestion Control for TCP in data center networks

Proceedings of the 6th International COnference
Preventing TCP incast throughput collapse at the initiation, continuation, and termination

Proceedings of the 2012 IEEE 20th International Workshop on Quality of Service
A switch-based approach to throughput collapse and starvation in data centers

Computer Networks: The International Journal of Computer and Telecommunications Networking
ICTCP: incast congestion control for TCP in data-center networks

IEEE/ACM Transactions on Networking (TON)

Quantified Score

Hi-index	0.00

Visualization

Abstract

TCP Incast plagues scalable cluster-based storage built atop standard TCP/IP-over-Ethernet, often resulting in much lower client read bandwidth than can be provided by the available network links. This paper reviews the Incast problem and discusses potential application-level approaches to avoiding it.