Software reliability: measurement, prediction, application
Software reliability: measurement, prediction, application
Software Reliability as a Function of User Execution Patterns
HICSS '99 Proceedings of the Thirty-second Annual Hawaii International Conference on System Sciences-Volume 8 - Volume 8
User-Oriented Reliability Modeling for a Web System
ISSRE '03 Proceedings of the 14th International Symposium on Software Reliability Engineering
Reliability Estimation for Statistical Usage Testing using Markov Chains
ISSRE '04 Proceedings of the 15th International Symposium on Software Reliability Engineering
Automating Software Failure Reporting
Queue - System Failures
Predictors of customer perceived software quality
Proceedings of the 27th international conference on Software engineering
Profiling Deployed Software: Assessing Strategies and Testing Opportunities
IEEE Transactions on Software Engineering
Proceedings of the 28th international conference on Software engineering
Probe Distribution Techniques to Profile Events in Deployed Software
ISSRE '06 Proceedings of the 17th International Symposium on Software Reliability Engineering
Windows XP kernel crash analysis
LISA '06 Proceedings of the 20th conference on Large Installation System Administration
A User-Oriented Software Reliability Model
IEEE Transactions on Software Engineering
Sensitivity of Website Reliability to Usage Profile Changes
ISSRE '07 Proceedings of the The 18th IEEE International Symposium on Software Reliability
Corroborating User Assessments of Software Behavior to Facilitate Operational Testing
ISSRE '07 Proceedings of the The 18th IEEE International Symposium on Software Reliability
An Industrial Case Study of Customizing Operational Profiles Using Log Compression
Proceedings of the 30th international conference on Software engineering
Reliability Assessment of Mass-Market Software: Insights from Windows Vista®
ISSRE '08 Proceedings of the 2008 19th International Symposium on Software Reliability Engineering
Debugging in the (very) large: ten years of implementation and experience
Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles
Informing development decisions: from data to information
Proceedings of the 2013 International Conference on Software Engineering
The impact of tangled code changes
Proceedings of the 10th Working Conference on Mining Software Repositories
Hi-index | 0.00 |
Many software producers utilize beta programs to predict post-release quality and to ensure that their products meet quality expectations of users. Prior work indicates that software producers need to adjust predictions to account for usage environments and usage scenarios differences between beta populations and post-release populations. However, little is known about how usage characteristics relate to field quality and how usage characteristics differ between beta and post-release. In this study, we examine application crash, application hang, system crash, and usage information from millions of Windows® users to 1) examine the effects of usage characteristics differences on field quality (e.g. which usage characteristics impact quality), 2) examine usage characteristics differences between beta and post-release (e.g. do impactful usage characteristics differ), and 3) report experiences adjusting field quality predictions for Windows. Among the 18 usage characteristics that we examined, the five most important were: the number of application executed, whether the machines was pre-installed by the original equipment manufacturer, two sub-populations (two language/geographic locales), and whether Windows was 64-bit (not 32-bit). We found each of these usage characteristics to differ between beta and post-release, and by adjusting for the differences, accuracy of field quality predictions for Windows improved by ~59%.