Improving Hadoop performance in intercloud environments

Authors:
Shingyu Kim;Junghee Won;Hyuck Han;Hyeonsang Eom;Heon Y. Yeom
Affiliations:
Seoul National University;SAP Korea Ltd.;Seoul National University;Seoul National University;Seoul National University
Venue:
ACM SIGMETRICS Performance Evaluation Review
Year:
2011

Citing 4
Cited 0

MOON: MapReduce On Opportunistic eNvironments

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Improving MapReduce performance in heterogeneous environments

OSDI'08 Proceedings of the 8th USENIX conference on Operating systems design and implementation
Breaking the MapReduce Stage Barrier

CLUSTER '10 Proceedings of the 2010 IEEE International Conference on Cluster Computing
Reining in the outliers in map-reduce clusters using Mantri

OSDI'10 Proceedings of the 9th USENIX conference on Operating systems design and implementation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Intercloud is a federated environment of private clusters and public clouds. The performance of Hadoop could be degraded significantly in intercloud environments. Because previous solutions for intercloud environments rely on speculative execution, they require additional cost in the cloud. In this paper, we propose a new task scheduler that improves performance without the help of speculative execution in intercloud environments.