Low Latency High Bandwidth Message Transfer Mechanisms for a Network Interface Plugged into a Memory Slot

  • Authors:
  • Noboru Tanabe;Junji Yamamoto;Hiroaki Nishi;Tomohiro Kudoh;Yoshihiro Hamada;Hironori Nakajo;Hideharu Amano

  • Affiliations:
  • TOSHIBA R & D Center, 1 Komukai-Toshiba-cho, Saiwai-ku, Kawasaki, 210-8582, Japan;RWCP Tsukuba Research Center, Tsukuba Mitsui Building, Tsukuba, 305-0032, Japan;RWCP Tsukuba Research Center, Tsukuba Mitsui Building, Tsukuba, 305-0032, Japan;RWCP Tsukuba Research Center, Tsukuba Mitsui Building, Tsukuba, 305-0032, Japan;Tokyo University of Agriculture and Technology, Naka-cho Koganei, 184-8588, Japan;Tokyo University of Agriculture and Technology, Naka-cho Koganei, 184-8588, Japan;Keio University, Hiyoshi Yokohama, 223-8522, Japan

  • Venue:
  • Cluster Computing
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

The communication architecture of the DIMMnet-1 network interface based on MEMOnet is described. MEMOnet is a class of a network interface plugged into a memory slot. This paper proposes three message transfer mechanisms named atomic on-the-fly sending (AOTF), block on-the-fly sending (BOTF) and OTF receiving with selective address translation. The DIMMnet-1 prototype will have an ASIC named Martini, two banks of PC133 based SO-DIMM slots and an 8 Gbps full duplex optical link. The software overhead incurred to generate a message is only 1 CPU cycle and the estimated hardware delay is 105 ns using AOTF. The estimated hardware delay for receiving to on chip memory using OTF receiver is 90 ns. The estimated achievable sending bandwidth of DIMMnet-1 using BOTF is 984 MB/s which was observed in our experiments. This bandwidth is 7.4 times higher than the maximum bandwidth of PCI. This high performance is available even when simultaneous sending and receiving are executed on a cheap personal computer with DIMM slots. This paper also discribes the effects of BOTF for a PCI-based NIC.