Quantitative system performance: computer system analysis using queueing network models
Quantitative system performance: computer system analysis using queueing network models
Open, Closed, and Mixed Networks of Queues with Different Classes of Customers
Journal of the ACM (JACM)
Capacity Planning for Web Services: metrics, models, and methods
Capacity Planning for Web Services: metrics, models, and methods
Queueing network analysis: concepts, terminology, and methods
Journal of Systems and Software
Performance by Design: Computer Capacity Planning By Example
Performance by Design: Computer Capacity Planning By Example
Java Modelling Tools: an Open Source Suite for Queueing Network Modelling andWorkload Analysis
QEST '06 Proceedings of the 3rd international conference on the Quantitative Evaluation of Systems
Robust Workload Estimation in Queueing Network Performance Models
PDP '08 Proceedings of the 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008)
Enhanced Modeling and Solution of Layered Queueing Networks
IEEE Transactions on Software Engineering
Automated analysis of load testing results
Proceedings of the 19th international symposium on Software testing and analysis
A Reactivity-based Framework of Automated Performance Testing for Web Applications
DCABES '10 Proceedings of the 2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science
Automated detection of performance regressions using statistical process control techniques
ICPE '12 Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering
Solving Enterprise Applications Performance Puzzles: Queuing Models to the Rescue
Solving Enterprise Applications Performance Puzzles: Queuing Models to the Rescue
Using Control Charts for Detecting and Understanding Performance Regressions in Large Software
ICST '12 Proceedings of the 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation
CSMR '13 Proceedings of the 2013 17th European Conference on Software Maintenance and Reengineering
Software contention aware queueing network model of three-tier web systems
Proceedings of the 5th ACM/SPEC international conference on Performance engineering
| Hi-index | 0.00 |
Performance regression testing is an important step in the production process of enterprise applications. Yet, analysing this type of testing data is mainly conducted manually and depends on the load applied during the test. To ease such a manual task we present an automated, load-independent technique to detect performance regression anomalies based on the analysis of performance testing data using a concept known as Transaction Profile. The approach can be automated and it utilises data already available to the performance testing along with the queueing network model of the testing system. The presented ``Transaction Profile Run Report'' was able to automatically catch performance regression anomalies ca-used by software changes and isolate them from those caused by load variations with a precision of 80% in a case study conducted against an open source application. Hence, by deploying our system, the testing teams are able to detect performance regression anomalies by avoiding the manual approach and eliminating the need to do extra runs with varying load.