Distributed paged hash tables

  • Authors:
  • José Rufino;António Pina;Albano Alves;José Exposto

  • Affiliations:
  • Polytechnic Institute of Bragança, Bragança, Portugal;University of Minho, Braga, Portugal;Polytechnic Institute of Bragança, Bragança, Portugal;Polytechnic Institute of Bragança, Bragança, Portugal

  • Venue:
  • VECPAR'02 Proceedings of the 5th international conference on High performance computing for computational science
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present the design and implementation of DPH, a storage layer for cluster environments. DPH is a Distributed Data Structure (DDS) based on the distribution of a paged hash table. It combines main memory with file system resources across the cluster in order to implement a distributed dictionary that can be used for the storage of very large data sets with key based addressing techniques. The DPH storage layer is supported by a collection of cluster-aware utilities and services. Access to the DPH interface is provided by a user-level API. A preliminary performance evaluation shows promising results.