SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Power provisioning for a warehouse-sized computer
Proceedings of the 34th annual international symposium on Computer architecture
Bigtable: a distributed storage system for structured data
OSDI '06 Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation - Volume 7
MapReduce: simplified data processing on large clusters
Communications of the ACM - 50th anniversary issue: 1958 - 2008
PowerNap: eliminating server idle power
Proceedings of the 14th international conference on Architectural support for programming languages and operating systems
A comparison of high-level full-system power models
HotPower'08 Proceedings of the 2008 conference on Power aware computing and systems
On energy management, load balancing and replication
ACM SIGMOD Record
Wimpy node clusters: what about non-wimpy workloads?
Proceedings of the Sixth International Workshop on Data Management on New Hardware
GreenHDFS: towards an energy-conserving, storage-efficient, hybrid Hadoop compute cluster
HotPower'10 Proceedings of the 2010 international conference on Power aware computing and systems
Blink: managing server clusters on intermittent power
Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems
A case for micro-cellstores: energy-efficient data management on recycled smartphones
Proceedings of the Seventh International Workshop on Data Management on New Hardware
Towards continuous policy-driven demand response in data centers
Proceedings of the 2nd ACM SIGCOMM workshop on Green networking
Energy proportionality and performance in data parallel computing clusters
SSDBM'11 Proceedings of the 23rd international conference on Scientific and statistical database management
Energy efficient scheduling of MapReduce workloads on heterogeneous clusters
Green Computing Middleware on Proceedings of the 2nd International Workshop
Parallel data processing with MapReduce: a survey
ACM SIGMOD Record
Energy efficiency for large-scale MapReduce workloads with significant interactive analysis
Proceedings of the 7th ACM european conference on Computer Systems
GreenHadoop: leveraging green energy in data-processing frameworks
Proceedings of the 7th ACM european conference on Computer Systems
Achieving power-efficiency in clusters without distributed file system complexity
ISCA'10 Proceedings of the 2010 international conference on Computer Architecture
Future Generation Computer Systems
Towards energy-efficient database cluster design
Proceedings of the VLDB Endowment
PowerTracer: tracing requests in multi-tier services to diagnose energy inefficiency
Proceedings of the 9th international conference on Autonomic computing
Power-reduction techniques for data-center storage systems
ACM Computing Surveys (CSUR)
Investigating hybrid SSD FTL schemes for Hadoop workloads
Proceedings of the ACM International Conference on Computing Frontiers
Energy efficiency for MapReduce workloads: an in-depth study
ADC '12 Proceedings of the Twenty-Third Australasian Database Conference - Volume 124
Resource efficient computing for warehouse-scale datacenters
Proceedings of the Conference on Design, Automation and Test in Europe
Techniques for energy-efficient power budgeting in data centers
Proceedings of the 50th Annual Design Automation Conference
Exploiting Redundancies and Deferred Writes to Conserve Energy in Erasure-Coded Storage Clusters
ACM Transactions on Storage (TOS)
Boosting energy efficiency with mirrored data block replication policy and energy scheduler
ACM SIGOPS Operating Systems Review
Copysets: reducing the frequency of data loss in cloud storage
USENIX ATC'13 Proceedings of the 2013 USENIX conference on Annual Technical Conference
QoS-Aware scheduling in heterogeneous datacenters with paragon
ACM Transactions on Computer Systems (TOCS)
A three-phase energy-saving strategy for cloud storage systems
Journal of Systems and Software
Journal of Parallel and Distributed Computing
On the energy overhead of mobile storage systems
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
SpringFS: bridging agility and performance in elastic distributed storage
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
MapReduce framework energy adaptation via temperature awareness
Cluster Computing
| Hi-index | 0.00 |
Distributed processing frameworks, such as Yahoo!'s Hadoop and Google's MapReduce, have been successful at harnessing expansive datacenter resources for large-scale data analysis. However, their effect on datacenter energy efficiency has not been scrutinized. Moreover, the filesystem component of these frameworks effectively precludes scale-down of clusters deploying these frameworks (i.e. operating at reduced capacity). This paper presents our early work on modifying Hadoop to allow scale-down of operational clusters. We find that running Hadoop clusters in fractional configurations can save between 9% and 50% of energy consumption, and that there is a tradeoff between performance energy consumption. We also outline further research into the energy-efficiency of these frameworks.