Journal of Algorithms
The communication challenge for MPP: Intel Paragon and Meiko CS-2
Parallel Computing
On Evaluating and Optimizing Weights for Weighted Random Pattern Testing
IEEE Transactions on Computers
Effects of communication latency, overhead, and bandwidth in a cluster architecture
Proceedings of the 24th annual international symposium on Computer architecture
HPCN Europe 1998 Proceedings of the International Conference and Exhibition on High-Performance Computing and Networking
MiMPI: A Multithred-Safe Implementation of MPI
Proceedings of the 6th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Reproducible Measurements of MPI Performance Characteristics
Proceedings of the 6th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Fast Lossless Compression of Scientific Floating-Point Data
DCC '06 Proceedings of the Data Compression Conference
Image segmentation based on merging of sub-optimal segmentations
Pattern Recognition Letters
SKaMPI: a comprehensive benchmark for public benchmarking of MPI
Scientific Programming
HPCS '08 Proceedings of the 2008 22nd International Symposium on High Performance Computing Systems and Applications
FPC: A High-Speed Compressor for Double-Precision Floating-Point Data
IEEE Transactions on Computers
CoMPI: Enhancing MPI Based Applications Performance and Scalability Using Run-Time Compression
Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Issues in developing a thread-safe MPI implementation
EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
Prediction of communication latency over complex network behaviors on SMP clusters
EPEW'05/WS-FM'05 Proceedings of the 2005 international conference on European Performance Engineering, and Web Services and Formal Methods, international conference on Formal Techniques for Computer Systems and Business Processes
An adaptive, scalable, and portable technique for speeding up MPI-based applications
Euro-Par'12 Proceedings of the 18th international conference on Parallel Processing
| Hi-index | 0.01 |
This paper presents an optimization of MPI communication, called Adaptive-CoMPI, based on runtime compression of MPI messages exchanged by applications. The technique developed can be used for any application, because its implementation is transparent for the user, and integrates different compression algorithms for both MPI collective and point-to-point primitives. Furthermore, compression is turned on and off and the most appropriate compression algorithms are selected at runtime, depending on the characteristics of each message, the network behavior, and compression algorithm behavior, following a runtime adaptive strategy. Our system can be optimized for a specific application, through a guided strategy, to reduce the runtime strategy overhead. Adaptive-CoMPI has been validated using several MPI benchmarks and real HPC applications. Results show that, in most cases, by using adaptive compression, communication time is reduced, enhancing application performance and scalability.