X-device query processing by bitwise distribution

  • Authors:
  • Holger Pirk;Thibault Sellam;Stefan Manegold;Martin Kersten

  • Affiliations:
  • CWI, Amsterdam, The Netherlands;CWI, Amsterdam, The Netherlands;CWI, Amsterdam, The Netherlands;CWI, Amsterdam, The Netherlands

  • Venue:
  • DaMoN '12 Proceedings of the Eighth International Workshop on Data Management on New Hardware
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

The diversity of hardware components within a single system calls for strategies for efficient cross-device data processing. For example, existing approaches to CPU/GPU co-processing distribute individual relational operators to the "most appropriate" device. While pleasantly simple, this strategy has a number of problems: it may leave the "inappropriate" devices idle while overloading the "appropriate" device and putting a high pressure on the PCI bus. To address these issues we distribute data among the devices by partially decomposing relations at the granularity of individual bits. Each of the resulting bit-partitions is stored and processed on one of the available devices. Using this strategy, we implemented a processor for spatial range queries that makes efficient use of all available devices. The performance gains achieved indicate that bitwise distribution makes a good cross-device processing strategy.