Extracting and predicting the communication behaviour of parallel applications

  • Authors:
  • Rodrigo Fernandes de Mello;Evgueni Dodonov;Ricardo Bertagna;Luciano Jose Senger

  • Affiliations:
  • Institute of Mathematics and Computer Science, University of Sao Paulo, SP, Sao Carlos, Brazil;Institute of Mathematics and Computer Science, University of Sao Paulo, SP, Sao Carlos, Brazil;Institute of Mathematics and Computer Science, University of Sao Paulo, SP, Sao Carlos, Brazil;Department of Informatics, State University of Ponta Grossa, PR, Ponta Grossa, Brazil

  • Venue:
  • International Journal of Parallel, Emergent and Distributed Systems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a model to extract and predict the communication behaviour of parallel applications. The behaviour was extracted by introducing system calls in the Linux kernel to obtain the communication information about application tasks. The extracted information is organised as time series of the number of bytes transmitted and received during the task's execution time. The dimension of these time series is reduced by using a self-organising neural network architecture that detects common resource usage states and compacts communication events. This reduction simplifies the design of the prediction model as it does not need to consider too many different communication characteristics. The reduced information is submitted to a time-delay neural network that allows to predict the volume of future data transfers. The resulting predictions may be used in scheduling algorithms, allowing to define the best resources to be allocated according to communication events. If there is no communication it is possible to distribute processes just considering CPU capacity, otherwise it is necessary to evaluate when and how many bytes are transferred to allocate tasks in neighbour networks.