Comparative Models of the File Assignment Problem
ACM Computing Surveys (CSUR)
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Modeling the Clickstream: Implications for Web-Based Advertising Efforts
Marketing Science
Balance of Power: Dynamic Thermal Management for Internet Data Centers
IEEE Internet Computing
Mercury and freon: temperature emulation and management for server systems
Proceedings of the 12th international conference on Architectural support for programming languages and operating systems
Making scheduling "cool": temperature-aware workload placement in data centers
ATEC '05 Proceedings of the annual conference on USENIX Annual Technical Conference
MapReduce: simplified data processing on large clusters
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
IEEE Transactions on Parallel and Distributed Systems
Weatherman: Automated, Online and Predictive Thermal Mapping and Management for Data Centers
ICAC '06 Proceedings of the 2006 IEEE International Conference on Autonomic Computing
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
A cyber-physical systems approach to energy management in data centers
Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical Systems
A comparison of join algorithms for log processing in MaPreduce
Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Data warehousing and analytics infrastructure at facebook
Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
A 'cool' load balancer for parallel applications
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Predictive data and energy management in GreenHDFS
IGCC '11 Proceedings of the 2011 International Green Computing Conference and Workshops
Boosting energy efficiency with mirrored data block replication policy and energy scheduler
ACM SIGOPS Operating Systems Review
| Hi-index | 0.00 |
Explosion in Big Data has led to a surge in extremely large-scale Big Data analytics platforms, resulting in burgeoning energy costs. Big Data compute model mandates strong data-locality for computational performance, and moves computations to data. State-of-the-art cooling energy management techniques rely on thermal-aware computational job placement/migration and are inherently data-placement-agnostic in nature. T* takes a novel, data-centric approach to reduce cooling energy costs and to ensure thermal-reliability of the servers. T* is cognizant of the uneven thermal-profile and differences in thermal-reliability-driven load thresholds of the servers, and the differences in the computational jobs arrival rate, size, and evolution life spans of the Big Data placed in the cluster. Based on this knowledge, and coupled with its predictive file models and insights, T* does proactive, thermal-aware file placement, which implicitly results in thermal-aware job placement in the Big Data analytics compute model. Evaluation results with one-month long real-world Big Data analytics production traces from Yahoo! show up to 42% reduction in the cooling energy costs with T* courtesy of its lower and more uniform thermal-profile and 9x better performance than the state-of-the-art data-agnostic cooling techniques.