Software metrics: establishing a company-wide program
Software metrics: establishing a company-wide program
Orthogonal Defect Classification-A Concept for In-Process Measurements
IEEE Transactions on Software Engineering - Special issue on software measurement principles, techniques, and environments
A Practical View of Software Measurement and Implementation Experiences Within Motorola
IEEE Transactions on Software Engineering - Special issue on software measurement principles, techniques, and environments
Object-oriented software metrics: a practical guide
Object-oriented software metrics: a practical guide
Testing Very Big Systems
Software Metrics: A Rigorous and Practical Approach
Software Metrics: A Rigorous and Practical Approach
Evaluating Software Development Objectively
IEEE Software
Evaluating the Software Test Strategy for the 2000 Sydney Olympics
ISSRE '01 Proceedings of the 12th International Symposium on Software Reliability Engineering
In-process metrics for software testing
IBM Systems Journal
The commentator information system: a usability evaluation of a real-time sport information service
Proceedings of the international conference on Advances in computer entertainment technology
Journal of Systems and Software
| Hi-index | 0.00 |
Various business considerations have led a growing number of organizations to rely on external vendors to develop software for their needs. Much of the day-to-day data from vendors are not available to the vendee, and typically the vendee organization ends up with its own system or acceptance test to validate the software. The 2000 Summer Olympics in Sydney was one such project in which IBM evaluated vendor-delivered code to ensure that all elements of a highly complex system could be integrated successfully. The readiness of the vendor-delivered code was evaluated based primarily on the actual test execution results. New metrics were derived to measure the degree of risk associated with a variety of test case failures such as functionality not enabled, bad fixes, and defects not fixed during successive iterations. The relationship of these metrics to the actual cause was validated through explicit communications with the vendor and the subsequent actions to improve the quality and completeness of the delivered code. This paper describes how these metrics can be derived from the execution data and used in a software project execution environment. Even though we have applied these metrics in a vendor-related project, the underlying concepts are useful to many software projects.