Distributed workload and response time management for web applications

  • Authors:

  • Shengzhi Zhang;Haishan Wu;Wenjie Wang;Bo Yang;Peng Liu;Athanasios V. Vasilakos

  • Affiliations:

  • The Penn State University, University Park, PA;IBM Research - China, Beijing, China;Shanghai Synacast Media Tech. (PPLive) Inc. China;IBM Research - China, Beijing, China;The Penn State University, University Park, PA and National Technical University of Athens, Greece;National Technical University of Athens, Greece

  • Venue:
  • Proceedings of the 7th International Conference on Network and Services Management
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Managing workload for large scale web applications is a fundamental task for satisfactory quality of service, low management and operation cost. In this paper, we present SCOPS, a system of distributed workload management to achieve service differentiation and overload protection in such large scale deployment. Our system splits the workload management logic into distributed components on each back-end server and frontend proxy. The control solution is designed to protect the backend server from overloading and to achieve both efficient usage of system resource and service differentiation by employing a unique optimization target. The control components are automatically organized based on the flow of workloads, such that management overhead is minimized. SCOPS is extremely flexible because it requires no source code changes to host OS, application servers, or web applications. Additionally, the distributed design makes it scalable and robust for cloud scale server deployment. Experiments with our implementation confirm SCOPS's performance with dynamic heavy workload, incurring neglectable runtime overhead. More importantly, SCOPS also ensures fault-tolerance and fast convergence to system failures.