On the effectiveness of application-aware self-management for scientific discovery in volunteer computing systems

  • Authors:
  • Trilce Estrada;Michela Taufer

  • Affiliations:
  • University of Delaware, Newark, Delaware;University of Delaware, Newark, Delaware

  • Venue:
  • SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

An important challenge faced by high-throughput, multiscale applications is that human intervention has a central role in driving their success. However, manual intervention is in-efficient, error-prone and promotes resource wasting. This paper presents an application-aware modular framework that provides self-management for computational multiscale applications in volunteer computing (VC). Our framework consists of a learning engine and three modules that can be easily adapted to different distributed systems. The learning engine of this framework is based on our novel tree-like structure called KOTree. KOTree is a fully automatic method that organizes statistical information in a multidimensional structure that can be efficiently searched and updated at runtime. Our empirical evaluation shows that our framework can effectively provide application-aware self-management in VC systems. Additionally, we observed that our KOTree algorithm is able to predict accurately the expected length of new jobs, resulting in an average of 85% increased throughput with respect to other algorithms.