Towards a framework for source code instrumentation measurement validation

Authors:
Haleh Najafzadeh;Seth Chaiken
Affiliations:
University at Albany, State University of New York;University at Albany, State University of New York
Venue:
Proceedings of the 5th international workshop on Software and performance
Year:
2005

Citing 7
Cited 1

Introduction to algorithms

Introduction to algorithms
Methodology for Validating Software Metrics

IEEE Transactions on Software Engineering
Computer architecture (2nd ed.): a quantitative approach

Computer architecture (2nd ed.): a quantitative approach
Performance Measurement Intrusion and Perturbation Analysis

IEEE Transactions on Parallel and Distributed Systems
Software Measurement: A Necessary Scientific Basis

IEEE Transactions on Software Engineering
Towards a Framework for Software Measurement Validation

IEEE Transactions on Software Engineering
Validated observation and reporting of microscopic performance using Pentium II counter facilities

WOSP '04 Proceedings of the 4th international workshop on Software and performance

CAMP: a common API for measuring performance

LISA'07 Proceedings of the 21st conference on Large Installation System Administration Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

Ignoring monitoring overhead and not validating measurements are two common mistakes in benchmarking. We extend, apply and evaluate for a practical FFT library our own methodologies for overhead compensation and over-all validation. The overhead and error sources we address include the source instrumentation and separate activities unrelated to the phenomena under study. We are able to quantify the differences with simpler compared with more portable probe technology and relate them to compiler optimization effects. Finally we formulate our framework for validating performance measurement using software accessible counters within existing framework for general software measurements.