IBM scale out file services: reinventing network-attached storage

  • Authors:
  • S. Oehme;J. Deicke;J.-P. Akelbein;R. Sahlberg;A. Tridgell;R. L. Haskin

  • Affiliations:
  • IBM Deutschland GmbH, Mainz, Germany;IBM Deutschland GmbH, Mainz, Germany;IBM Deutschland GmbH, Mainz, Germany;IBM Australia, Canberra, ACT, Australia;IBM Australia, Canberra, ACT, Australia;IBM Almaden Research Center, San Jose, California

  • Venue:
  • IBM Journal of Research and Development
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper focuses on the challenges of creating a scalable network-attached storage (NAS) filer with hundreds of nodes on top of the IBM General Parallel File System™ (GPFS™). The filer is created as a multiheaded data exporter over Ethernet and uses the Common Internet File System (CIFS) as implemented by the Samba open-source project and a Network File System (NFS) protocol server. Special focus is given to ensure the consistency of data in an efficient manner for applications that have complex access patterns from a large number of nodes. Also considered are the challenges of providing an extremely high-performance facility for exporting data in parallel and the demands of storing very large amounts of data. Introducing new aspects of storage management--such as storage pools and fle sets as they are implemented in current file systems--into NAS appliances enables the management of large amounts of data in a single namespace.