Performance Evaluation of the Quadrics Interconnection Network
Cluster Computing
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Fault Tolerance in Message Passing Interface Programs
International Journal of High Performance Computing Applications
Google's PageRank and Beyond: The Science of Search Engine Rankings
Google's PageRank and Beyond: The Science of Search Engine Rankings
Interpreting the data: Parallel analysis with Sawzall
Scientific Programming - Dynamic Grids and Worldwide Computing
Google's MapReduce programming model — Revisited
Science of Computer Programming
Evaluating MapReduce for Multi-core and Multiprocessor Systems
HPCA '07 Proceedings of the 2007 IEEE 13th International Symposium on High Performance Computer Architecture
MapReduce: simplified data processing on large clusters
Communications of the ACM - 50th anniversary issue: 1958 - 2008
Design and implementation of a high-performance MPI for C# and the common language infrastructure
Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming
Cluster computing for web-scale data processing
Proceedings of the 39th SIGCSE technical symposium on Computer science education
Implementation and performance analysis of non-blocking collective operations for MPI
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Mars: a MapReduce framework on graphics processors
Proceedings of the 17th international conference on Parallel architectures and compilation techniques
Overview of the Blue Gene/L system architecture
IBM Journal of Research and Development
MapReduce for the cell broadband engine architecture
IBM Journal of Research and Development
Scalable fault tolerant MPI: extending the recovery algorithm
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
A case for standard non-blocking collective operations
PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Simplified parallel domain traversal
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
MapReduce in MPI for Large-scale graph algorithms
Parallel Computing
MRKDSBC: a distributed background modeling algorithm based on mapreduce
ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
Adapting MPI to MapReduce PaaS Clouds: An Experiment in Cross-Paradigm Execution
UCC '12 Proceedings of the 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing
MR-search: massively parallel heuristic search
Concurrency and Computation: Practice & Experience
Performance comparison under failures of MPI and MapReduce: An analytical approach
Future Generation Computer Systems
Distributed media indexing based on MPI and MapReduce
Multimedia Tools and Applications
| Hi-index | 0.00 |
MapReduce is an emerging programming paradigm for data-parallel applications. We discuss common strategies to implement a MapReduce runtime and propose an optimized implementation on top of MPI. Our implementation combines redistribution and reduce and moves them into the network . This approach especially benefits applications with a limited number of output keys in the map phase. We also show how anticipated MPI-2.2 and MPI-3 features, such as MPI_Reduce_local and nonblocking collective operations, can be used to implement and optimize MapReduce with a performance improvement of up to 25% on 127 cluster nodes. Finally, we discuss additional features that would enable MPI to more efficiently support all MapReduce applications.