Fast dynamic memory allocator for massively parallel architectures

  • Authors:
  • Sven Widmer;Dominik Wodniok;Nicolas Weber;Michael Goesele

  • Affiliations:
  • Graduate School Computational Engineering, TU Darmstadt;Graduate School Computational Engineering, TU Darmstadt;TU Darmstadt;Graduate School Computational Engineering, TU Darmstadt

  • Venue:
  • Proceedings of the 6th Workshop on General Purpose Processor Using Graphics Processing Units
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Dynamic memory allocation in massively parallel systems often suffers from drastic performance decreases due to the required global synchronization. This is especially true when many allocation or deallocation requests occur in parallel. We propose a method to alleviate this problem by making use of the SIMD parallelism found in most current massively parallel hardware. More specifically, we propose a hybrid dynamic memory allocator operating at the SIMD parallel warp level. Using additional constraints that can be fulfilled for a large class of practically relevant algorithms and hardware systems, we are able to significantly speed-up the dynamic allocation. We present and evaluate a prototypical implementation for modern CUDA-enabled graphics cards, achieving an overall speedup of up to several orders of magnitude.