Analyzing the Influence of Virtual Lanes on the Performance of InfiniBand Networks

  • Authors:
  • José Carlos Sancho;Jose Flich;Antonio Robles;P. L. López;José Duato

  • Affiliations:
  • -;-;-;-;-

  • Venue:
  • IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

InfiniBand is very likely to become the de facto standard for communication between processing nodes and I/O devices as well as for interprocessor communication. The InfiniBand Architecture (IBA) supports up to 15 data virtual lanes per physical link, primarily intended for traffic prioritization, deadlock avoidance, and quality of service. However, virtual lanes may also contribute to improve performance by reducing the influence of the head-of-line blocking effect on input physical ports. On the other hand, when virtual lanes are used, crossbar complexity may be increased.The main goal of this paper is to show at what extent the use of virtual lanes may contribute to improve network performance on an InfiniBand environment, obtaining the trade-off between the number of virtual lanes and performance improvement. Different configurations (crossbar organization, crossbar bandwidth, and link bandwidth) are used. Evaluation results using up*/down* routing show that two virtual lanes are often enough to achieve the most of the improvement on performance, allowing the use of the remaining virtual lanes for other purposes. Additionally, by increasing the crossbar bandwidth, a lower complexity crossbar configuration can be used.