A framework for scalable, parallel performance monitoring

  • Authors:

  • Aroon Nataraj;Allen D. Malony;Alan Morris;Dorian C. Arnold;Barton P. Miller

  • Affiliations:

  • Department of Computer and Information Science, University of Oregon, Eugene, OR, U.S.A.;Department of Computer and Information Science, University of Oregon, Eugene, OR, U.S.A.;Department of Computer and Information Science, University of Oregon, Eugene, OR, U.S.A.;Computer Sciences Department, University of Wisconsin, Madison, WI, U.S.A.;Computer Sciences Department, University of Wisconsin, Madison, WI, U.S.A.

  • Venue:
  • Concurrency and Computation: Practice & Experience - Scalable Tools for High-End Computing
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Performance monitoring of HPC applications offers opportunities for adaptive optimization based on the dynamic performance behavior, unavailable in purely post-mortem performance views. However, a parallel performance monitoring system must have low overhead and high efficiency to make these opportunities tangible. We describe a scalable parallel performance monitor called TAUoverMRNet (ToM), created from the integration of the TAU performance system and the Multicast Reduction Network (MRNet). The integration is achieved through a plug-in architecture in TAU that allows the selection of different transport substrates to offload the online performance data. A method to establish the transport overlay structure of the monitor from within TAU, one that requires no added support from the job manager or application, is presented. We demonstrate the distribution of performance analysis from the sink to the overlay nodes and the reduction in the large-scale profile data that could, otherwise, overwhelm any single sink. The results show low perturbation and significant savings accrued from reduction at large processor-counts. Copyright © 2009 John Wiley & Sons, Ltd.