HSim: A MapReduce simulator in enabling Cloud Computing

Authors:
Yang Liu;Maozhen Li;Nasullah Khalid Alham;Suhel Hammoud
Affiliations:
School of Engineering and Design, Brunel University, Uxbridge, Middlesex, UB8 3PH, UK;School of Engineering and Design, Brunel University, Uxbridge, Middlesex, UB8 3PH, UK and The Key Laboratory of Embedded System and Service Computing, Ministry of Education, Tongji University, Sha ...;School of Engineering and Design, Brunel University, Uxbridge, Middlesex, UB8 3PH, UK;School of Engineering and Design, Brunel University, Uxbridge, Middlesex, UB8 3PH, UK
Venue:
Future Generation Computer Systems
Year:
2013

Citing 6
Cited 2

Phoenix: a parallel programming model for accommodating dynamically joining/leaving resources

Proceedings of the ninth ACM SIGPLAN symposium on Principles and practice of parallel programming
MapReduce: simplified data processing on large clusters

Communications of the ACM - 50th anniversary issue: 1958 - 2008
Mars: a MapReduce framework on graphics processors

Proceedings of the 17th international conference on Parallel architectures and compilation techniques
Using realistic simulation for performance analysis of mapreduce setups

Proceedings of the 1st ACM workshop on Large-Scale system and application performance
A comparison of approaches to large-scale data analysis

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Pro Hadoop

Pro Hadoop

Ad-hoc aggregate query processing algorithms based on bit-store for query intensive applications in cloud computing

Future Generation Computer Systems
A MapReduce-based distributed SVM ensemble for scalable image classification and annotation

Computers & Mathematics with Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

MapReduce is an enabling technology in support of Cloud Computing. Hadoop which is a MapReduce implementation has been widely used in developing MapReduce applications. This paper presents HSim, a MapReduce simulator which builds on top of Hadoop. HSim models a large number of parameters that can affect the behaviors of MapReduce nodes, and thus it can be used to tune the performance of a MapReduce cluster. HSim is validated with both benchmark results and user customized MapReduce applications.