Automated tuning in parallel sorting on multi-core architectures

  • Authors:
  • Haibo Lin;Chao Li;Qian Wang;Yi Zhao;Ninghe Pan;Xiaotong Zhuang;Ling Shao

  • Affiliations:
  • IBM Research - Beijing, China;University of Massachusetts, Boston, MA;Beijing Institute of Technology, Beijing, China;IBM Research - Beijing, China;IBM Systems & Technology Group, Beijing, China;IBM Watson Research Center, Yorktown Heights, NY;IBM Research - Beijing, China

  • Venue:
  • EuroPar'10 Proceedings of the 16th international Euro-Par conference on Parallel processing: Part I
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Empirical search is an emerging strategy used in systems like ATLAS, FFTW and SPIRAL to find the parameter values of the implementation that deliver near-optimal performance for a particular machine. However, this approach has only proven successful for scientific kernels or serial symbolic sorting. Even commercial libraries like Intel MKL or IBM ESSL do not include parallel version of sorting routines. In this paper we study empirical search in the generation of parallel sorting routines for multi-core systems. Parallel sorting presents new challenges that the relative performance of the algorithms depends not only on the characteristics of the architectures and input data, but also on the data partitioning schemes and thread interactions. We have studied parallel sorting algorithms including quick sort, cache-conscious radix sort, multiway merge sort, sample sort and quick-radix sort, and have built a sorting library using empirical search and artificial neural network. Our results show that this sorting library could generate the best parallel sorting algorithms for different input sets on both x86 and SPARC multicore architectures, with a peak speedup of 2.2x and 3.9x, respectively.