Handling more data with less cost: taming power peaks in mapreduce clusters

  • Authors:
  • Nan Zhu;Lei Rao;Xue Liu;Jie Liu

  • Affiliations:
  • School of Computer Science, McGill University, Montreal, Canada;School of Computer Science, McGill University, Montreal, Canada;School of Computer Science, McGill University, Montreal, Canada;Microsoft Research, Microsoft Corp., Redmond

  • Venue:
  • APSys'12 Proceedings of the Third ACM SIGOPS Asia-Pacific conference on Systems
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Along with the surging service demands in the cloud, power provision infrastructure of Internet Data Centers (IDCs) has brought dramatically increasing capital cost. To enlarge the size of IDCs with lowest cost, power management of computing facilities has attracted many attentions in recent. A large portion of applications running on data centers are data-intensive and throughput-preferredMapReduce is one of them enjoying widely deployment. However the critical power peak problem in MapReduce clusters, which actually limits the cluster's size, has been overlooked. Wc study the power peak problem in MapReduce system and investigate the reason causing it. We design an adaptive approach to regulate power peaks. Evaluation result shows that our proposed method can effectively smooth the power consumption curve by reducing the peak value for 20% with little overhead in performance, and in turn extending the maximum size of the cluster with 25% under the same power budget.