Automated performance assessment for service-oriented middleware: a case study on BPEL engines

Authors:
Domenico Bianculli;Walter Binder;Mauro Luigi Drago
Affiliations:
University of Lugano, Lugano, Switzerland;University of Lugano, Lugano, Switzerland;Politecnico di Milano, Milano, Italy
Venue:
Proceedings of the 19th international conference on World wide web
Year:
2010

Citing 13
Cited 5

Quantitative system performance: computer system analysis using queueing network models

Quantitative system performance: computer system analysis using queueing network models
Computer Architecture; A Quantitative Approach

Computer Architecture; A Quantitative Approach
Service-Oriented Architecture: Concepts, Technology, and Design

Service-Oriented Architecture: Concepts, Technology, and Design
Automating experimentation on distributed testbeds

Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
Testability of Software in Service-Oriented Architecture

COMPSAC '06 Proceedings of the 30th Annual International Computer Software and Applications Conference - Volume 02
Toward Open-World Software: Issue and Challenges

Computer
Statistically rigorous java performance evaluation

Proceedings of the 22nd annual ACM SIGPLAN conference on Object-oriented programming systems and applications
Service-Oriented Computing: State of the Art and Research Challenges

Computer
Service Orientation in the Enterprise

Computer
GENESIS - A Framework for Automatic Generation and Steering of Testbeds of ComplexWeb Services

ICECCS '08 Proceedings of the 13th IEEE International Conference on on Engineering of Complex Computer Systems
Transparent Reputation Management for Composite Web Services

ICWS '08 Proceedings of the 2008 IEEE International Conference on Web Services
WS-TAXI: A WSDL-based Testing Tool for Web Services

ICST '09 Proceedings of the 2009 International Conference on Software Testing Verification and Validation
SPLAY: distributed systems evaluation made simple (or how to turn ideas into live systems in a breeze)

NSDI'09 Proceedings of the 6th USENIX symposium on Networked systems design and implementation

SOABench: performance evaluation of service-oriented middleware made easy

Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2
Testing in Service Oriented Architectures with dynamic binding: A mapping study

Information and Software Technology
Towards scalable service composition on multicores

OTM'10 Proceedings of the 2010 international conference on On the move to meaningful internet systems
Dynamic Replication in Service-Oriented Systems

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Optimizing service replication in clouds

Proceedings of the Winter Simulation Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

Middleware for Web service compositions, such as BPEL engines, provides the execution environment for services as well as additional functionalities, such as monitoring and self-tuning. Given its role in service provisioning, it is very important to assess the performance of middleware in the context of a SOA. This paper presents SOABench, a framework for the automatic generation and execution of testbeds for benchmarking middleware for composite Web services and for assessing the performance of existing SOA infrastructures. SOABench defines a testbed model characterized by the composite services to execute, the workload to generate, the deployment configuration to use, the performance metrics to gather, the data analyses to perform on them, and the reports to produce. We have validated SOABench by benchmarking the performance of different BPEL engines.