Cross-layer flow and congestion control for datacenter networks

  • Authors:
  • Andreea S. Anghel;Robert Birke;Daniel Crisan;Mitchell Gusat

  • Affiliations:
  • IBM Research, Zürich Research LaboratoryIBM Research, Zürich Research Laboratory, Rüschlikon, Switzerland;IBM Research, Zürich Research LaboratoryIBM Research, Zürich Research Laboratory, Rüschlikon, Switzerland;IBM Research, Zürich Research LaboratoryIBM Research, Zürich Research Laboratory, Rüschlikon, Switzerland;IBM Research, Zürich Research LaboratoryIBM Research, Zürich Research Laboratory, Rüschlikon, Switzerland

  • Venue:
  • Proceedings of the 3rd Workshop on Data Center - Converged and Virtual Ethernet Switching
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

A key feature of the upcoming datacenter networks is their losslessness, achieved by the means of Priority Flow Control (PFC). Inherited from the cluster and HPC networks that traditionally use link level flow control to prevent packet loss across multiple virtual lanes, channels and/or priorities, this feature is now also becoming widely available in the next generation 10, 40 and 100Gbps Ethernet switches and adapters. Nevertheless, excepting storage protocols such as Fibre Channel over Ethernet, PFC is new and unfamiliar to the majority of datacenter applications and protocols. That is, despite PFC's key role in the datacenter and its increasing availability -- supported by virtually all future Converged Enhanced Ethernet (CEE) products -- its impact on the higher layer routing and transport protocols has yet to be investigated. Hence our motivation to assess the performance exposure of three widespread TCP versions to PFC, as well as to the potentially conflicting Quantized Congestion Notification (QCN) congestion management mechanism, which apparently replicates on Layer 2 some more advanced TCP functionality. As workloads of interest we have selected a few revealing commercial and scientific applications. For quantitative performance evaluation we use two distinct methodologies: (a) Our reference is an accurate Layer 2 CEE 10Gbps network simulator intercoupled with TCP implementations extracted from FreeBSD v9; (b) A hardware setup scaled down in speed and size. The main outcome of our work is that PFC can notably improve the TCP performance across all tested configurations and workloads. This result was validated in both environments. Hence our recommendation to enable PFC whenever this is possible. By contrast, QCN can either harm or help depending on its parameter settings, and essentially, on the co-existence of competing UDP or other non-congestion-managed traffic.