Early Experiences with Write-Write Design of NFS over RDMA

  • Authors:
  • Bo Li;Panyong Zhang;Zhigang Huo;Dan Meng

  • Affiliations:
  • -;-;-;-

  • Venue:
  • NAS '09 Proceedings of the 2009 IEEE International Conference on Networking, Architecture, and Storage
  • Year:
  • 2009
  • FaRM: fast remote memory

    NSDI'14 Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Network File System (NFS) protocol, as the de facto standard for sharing files in a distributed environment, has deployed Infiniband as the underlying transport of sunRPC, namely NFS over RDMA. In the current Read-Write design of NFS over RDMA, NFS write performance is limited for not fully utilizing the features of Infiniband. In this paper, we take on the challenge of enhancing the write performance of NFS. We propose and evaluate a new design of sunRPC over RDMA, namely Write-Write design. To guarantee the security of our design, we propose an HCA-based memory protection extension of Infiniband. Evaluations show that our Write-Write design increases the kernel-to-kernel RPC bandwidth by 15~27%. In real disk test, our Write-Write design gains 15%~22% in multi-client benchmarks compared with the Read-Write design.