High Performance Support of Lustre over Customized HSNI for HPC

  • Authors:
  • Yufeng Guo;Xuejun Yang;Li Luo;Qiong Li;Lu Liu

  • Affiliations:
  • School of Computer, National University of Defense Technology, Changsha, China 410073;School of Computer, National University of Defense Technology, Changsha, China 410073;School of Computer, National University of Defense Technology, Changsha, China 410073;School of Computer, National University of Defense Technology, Changsha, China 410073;School of Computer, National University of Defense Technology, Changsha, China 410073

  • Venue:
  • APPT '09 Proceedings of the 8th International Symposium on Advanced Parallel Processing Technologies
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Parallel I/O needs keep pace with the demand of high performance computing applications. I/O bottleneck still is one of the key problems which restrict the development of high performance computer. Object-based storage combines the advantages of SAN and NAS, adopts an object-based interface, and has been a new orientation of massive storage. The trend as such makes it very promising to build a scalable I/O system for highperformance computing through implementation of object-based storage system based on high-performance interconnects. Lustre is a high performance distributed object parallel file system, is being widely studied and applied. Exploiting performance of Lustre depends on supports of high performance interconnects. In this paper, firstly we designed and implemented a customized high performance interconnect chip, HSNI (High performance Storage Network Interface), and introduced the characteristics of HSNI. Then we analyzed the communication features which support high performance of Lustre. Experimental results show that HSNI can greatly exert the performance of Lustre and has a very good scalability, so its very suitable for building the high performance object-based storage systems for high performance computing.