Performance Evaluation and Monitoring
ACM Computing Surveys (CSUR)
System performance evaluation: survey and appraisal
Communications of the ACM
| Hi-index | 0.00 |
The authors present this paper in the context of a successful acquisition of a multi user large scale batch processing system. They discuss the role of simulated demand (a) in determining basic system requirements, (b) as the major part of system specifications made available to vendors and (c) as a major tool in system testing and evaluation.They discuss the simulation of demand profiles from statistical records and user interviews and how this led to specifying minimum system requirements. The integration of simulated demand in formal system specifications is detailed. In particular, the assembly of an adequate test package to permit vendors to provide meaningful responses with their proposals is of interest. The authors show how an extensive series of benchmark programs and kernel routines were assembled to test adequately total system performance under various combinations. The evaluation process in terms of performance graphs in light of the initial specifications is reviewed.In summary, the authors discuss the results of specification, evaluation, selection and installation process in light of system suitability experienced after an initial period of use.