Performance evaluation of the RDMA over ethernet (RoCE) standard in enterprise data centers infrastructure

  • Authors:
  • Motti Beck;Michael Kagan

  • Affiliations:
  • Mellanox Technologies, Oakmead Parkway, Sunnyvale, CA;Mellanox Technologies, Oakmead Parkway, Sunnyvale, CA

  • Venue:
  • Proceedings of the 3rd Workshop on Data Center - Converged and Virtual Ethernet Switching
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

RDMA or Remote Direct Memory Access, communications using Send/Receive semantics and kernel bypass technologies in server and storage interconnect products permit high through-put and low-latency networking. As numbers of cores per server and cluster sizes servicing enterprise datacenters (EDC) applications have increased, the benefits of higher performance - aka completing the job faster -- are being increasingly complemented by the efficiency factor - being able to do more jobs with fewer servers. Data Center efficiency is synonymous with Return on Investment (ROI) has ever been a critical goal of the EDC, especially with the scaling needs of Web 2.0 and Cloud Computing applications. As such, the importance of low latency technologies such as RDMA has grown, and the need for efficient RDMA products that is broadly deployable across market and application segments has become critical. Recent enhancements to the Ethernet data link layer under the umbrella of IEEE Converged Enhance Ethernet (CEE) open significant opportunities to proliferate the use of RDMA, SEND/RECEIVE and kernel bypass into mainstream datacenter applications by taking a fresh and yet evolutionary look at how those services can be more easily and efficiently delivered over Ethernet. The CEE new standards include: 802.1Qbb -- Priority-based flow control, 802.1Qau -- End-to-End Congestion Notification, and 802.1Qaz -- Enhanced Transmission Selection and Data Center Bridge Exchange. The lossless delivery features in CEE enables a natural choice for building RDMA, SEND/RECEIVE and kernel bypass services over CEE is to apply RDMA transport services over CEE or in short RoCE. In April 2010, the RoCE -- RDMA over Converged Ethernet standard that enables the RDMA capabilities of InfiniBand™ to run over Ethernet was released by the InfiniBand® Trade Association (IBTA). Since then, RoCE has received broad industry support from many hardware, software and system vendors, as well as from industry organizations including the OpenFabrics Alliance and the Ethernet Alliance.