Adaptive disk spin—down for mobile computers
Mobile Networks and Applications
ASPLOS IX Proceedings of the ninth international conference on Architectural support for programming languages and operating systems
Conserving disk energy in network servers
ICS '03 Proceedings of the 17th annual international conference on Supercomputing
DRPM: dynamic speed control for power management in server class disks
Proceedings of the 30th annual international symposium on Computer architecture
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
A Power-Aware Run-Time System for High-Performance Computing
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
A new formalism for dynamic reconfiguration of data servers in a cluster
Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
Power provisioning for a warehouse-sized computer
Proceedings of the 34th annual international symposium on Computer architecture
Energy conservation policies for web servers
USITS'03 Proceedings of the 4th conference on USENIX Symposium on Internet Technologies and Systems - Volume 4
CCGRID '07 Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid
Scheduling for reduced CPU energy
OSDI '94 Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation
MapReduce: simplified data processing on large clusters
Communications of the ACM - 50th anniversary issue: 1958 - 2008
Compiler-directed frequency and voltage scaling for a multiple clock domain microarchitecture
Proceedings of the 5th conference on Computing frontiers
Future Generation Computer Systems
Making cluster applications energy-aware
ACDC '09 Proceedings of the 1st workshop on Automated control for datacenters and clouds
GreenCloud: a new architecture for green data center
ICAC-INDST '09 Proceedings of the 6th international conference industry session on Autonomic computing and communications industry session
Minimizing Energy Consumption for Precedence-Constrained Applications Using Dynamic Voltage Scaling
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Power-aware provisioning of Cloud resources for real-time services
Proceedings of the 7th International Workshop on Middleware for Grids, Clouds and e-Science
Power-Aware Management in Cloud Data Centers
CloudCom '09 Proceedings of the 1st International Conference on Cloud Computing
Learning based opportunistic admission control algorithm for MapReduce as a service
Proceedings of the 3rd India software engineering conference
On the energy (in)efficiency of Hadoop clusters
ACM SIGOPS Operating Systems Review
Energy-Efficient Cloud Computing
The Computer Journal
A three-phase energy-saving strategy for cloud storage systems
Journal of Systems and Software
| Hi-index | 0.00 |
With the recent emergence of cloud computing based services on the Internet, MapReduce and distributed file systems like HDFS have emerged as the paradigm of choice for developing large scale data intensive applications. Given the scale at which these applications are deployed, minimizing power consumption of these clusters can significantly cut down operational costs and reduce their carbon footprint-thereby increasing the utility from a provider's point of view. This paper addresses energy conservation for clusters of nodes that run MapReduce jobs. The algorithm dynamically reconfigures the cluster based on the current workload and turns cluster nodes on or off when the average cluster utilization rises above or falls below administrator specified thresholds, respectively. We evaluate our algorithm using the GridSim toolkit and our results show that the proposed algorithm achieves an energy reduction of 33% under average workloads and up to 54% under low workloads.