Implementation of execution history in non-relational databases for feedback-guided job modeling

  • Authors:
  • Sushan Chakraborty;Madhulina Sarkar;Nandini Mukherjee

  • Affiliations:
  • Jadavpur University, Kolkata;Govt. College of Engineering and Leather Technology, Kolkata;Jadavpur University, Kolkata

  • Venue:
  • Proceedings of the CUBE International Information Technology Conference
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

A feedback-guided Resource Requirement Prediction technique has been described in [2]. An Execution History is built and maintained for all the jobs which are executed in a large distributed system like Grid. When a new job arrives, its clones are sought for in the Execution History and if clones are found, relevant performance information are retrieved and used for estimating resource requirements. In this paper, we focus on the implementation details of Execution History. Instead of using relational databases, here we have used NoSQL database, MongoDB. The reasons for using MongoDB are discussed. Techniques for storing and retrieving data from the Execution History are also described. Overheads for such operations are measured and presented in the result part of this paper.