Wide area traffic: the failure of Poisson modeling
IEEE/ACM Transactions on Networking (TON)
Generating representative Web workloads for network and server performance evaluation
SIGMETRICS '98/PERFORMANCE '98 Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
httperf—a tool for measuring web server performance
ACM SIGMETRICS Performance Evaluation Review
Bro: a system for detecting network intruders in real-time
Computer Networks: The International Journal of Computer and Telecommunications Networking
The effects of wide-area conditions on WWW server performance
Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Traffic model and performance evaluation of Web servers
Performance Evaluation
Measuring the capacity of a Web server under realistic loads
World Wide Web
The Forgotten Factor: Facts on Performance Evaluation and Its Dependence on Workloads
Euro-Par '02 Proceedings of the 8th International Euro-Par Conference on Parallel Processing
On the foundations of artificial workload design
SIGMETRICS '84 Proceedings of the 1984 ACM SIGMETRICS conference on Measurement and modeling of computer systems
Myths and realities: the performance impact of garbage collection
Proceedings of the joint international conference on Measurement and modeling of computer systems
Tuning Dynamic Web Applications using Fine-Grain Analysis
PDP '05 Proceedings of the 13th Euromicro Conference on Parallel, Distributed and Network-Based Processing
Controlling garbage collection and heap growth to reduce the execution time of Java applications
ACM Transactions on Programming Languages and Systems (TOPLAS)
A Synthetic Workload Generation Technique for Stress Testing Session-Based Systems
IEEE Transactions on Software Engineering
Predicting short-transfer latency from TCP arcana: a trace-based validation
IMC '05 Proceedings of the 5th ACM SIGCOMM conference on Internet Measurement
Open versus closed: a cautionary tale
NSDI'06 Proceedings of the 3rd conference on Networked Systems Design & Implementation - Volume 3
Statistically rigorous java performance evaluation
Proceedings of the 22nd annual ACM SIGPLAN conference on Object-oriented programming systems and applications
Dynamic CPU provisioning for self-managed secure web applications in SMP hosting platforms
Computer Networks: The International Journal of Computer and Telecommunications Networking
Using components for architecture-based management: the self-repair case
Proceedings of the 30th international conference on Software engineering
Remote profiling of resource constraints of web servers using mini-flash crowds
ATC'08 USENIX 2008 Annual Technical Conference on Annual Technical Conference
Profiling and Modeling Resource Usage of Virtualized Applications
Middleware '08 Proceedings of the ACM/IFIP/USENIX 9th International Middleware Conference
Experimental evaluation of N-tier systems: Observation and analysis of multi-bottlenecks
IISWC '09 Proceedings of the 2009 IEEE International Symposium on Workload Characterization (IISWC)
BAP: a benchmark-driven algebraic method for the performance engineering of customized services
Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering
Exploiting memory usage patterns to improve garbage collections in Java
Proceedings of the 8th International Conference on the Principles and Practice of Programming in Java
A tool for the generation of realistic network workload for emerging networking scenarios
Computer Networks: The International Journal of Computer and Telecommunications Networking
| Hi-index | 0.00 |
Workload generators are widely used for testing the performance of Web-based systems. Typically, these tools are also used to collect measurements such as throughput and end-user response times that are often used to characterize the QoS provided by a system to its users. However, our study finds that Web workload generation is more difficult than it seems. In examining the popular RUBiS client generator, we found that reported response times could be grossly inaccurate, and that the generated workloads were less realistic than expected, causing server scalability to be incorrectly estimated. Using experimentation, we demonstrate how the Java virtual machine and the Java network library are the root causes of these issues. Our work serves as an example of how to verify the behavior of a Web workload generator. Copyright © 2011 John Wiley & Sons, Ltd.