HITP: A Transmission Protocol for Scalable High-Performance Distributed Storage

  • Authors:
  • P. Giacomin;A. Bassi;F. J. Seinstra;T. Kielmann;H. E. Bal

  • Affiliations:
  • Hitachi Sophia Antipolis Laboratory - Immeuble Le Thélème, Valbonne, France 06560 and Department of Computer Science, Vrije Universiteit, Amsterdam, The Netherlands 1081 HV;Hitachi Sophia Antipolis Laboratory - Immeuble Le Thélème, Valbonne, France 06560;Department of Computer Science, Vrije Universiteit, Amsterdam, The Netherlands 1081 HV;Department of Computer Science, Vrije Universiteit, Amsterdam, The Netherlands 1081 HV;Department of Computer Science, Vrije Universiteit, Amsterdam, The Netherlands 1081 HV

  • Venue:
  • Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
  • Year:
  • 2008

Quantified Score

Hi-index 0.03

Visualization

Abstract

In many application and research areas there is a trend towards petascaleprocessing and archiving of scientific measurement results and derived data structures. As a consequence, there is an urgent need for disruptive technologies that revolutionize the manner in which we integrate, coordinate, and distribute computing and storage of vast amounts of data. This paper discusses the INCA architecture, a system that aims at providing a sustainable solution to the management problem of data storagein very large-scale distributed systems. INCA provides a solution where 'intelligence' in a globally scalable system is put in the middleware, where the lower level deals with local problems only, while all other properties are taken care of at the upper layers. In particular, we focus on a new, efficient transport protocol (referred to as HITP) that is specifically designed for bulk data transfer over high-speed (optical) network connections. We present performance results for basic transmission functionality, and show that HITP is capable of achieving higher throughput and lower latency than existing transport protocols.