Dealer: application-aware request splitting for interactive cloud applications

  • Authors:

  • Mohammad Hajjat;Shankaranarayanan P. N;David Maltz;Sanjay Rao;Kunwadee Sripanidkulchai

  • Affiliations:

  • Purdue University, West Lafayette, IN, USA;Purdue University, West Lafayette, IN, USA;Microsoft, Redmond, WA, USA;Purdue University, West Lafayette, IN, USA;NECTEC Thailand, Pathumthani, Thailand

  • Venue:
  • Proceedings of the 8th international conference on Emerging networking experiments and technologies
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Deploying interactive applications in the cloud is a challenge due to the high variability in performance of cloud services. In this paper, we present Dealer-- a system that helps geo-distributed, interactive and multi-tier applications meet their stringent requirements on response time despite such variability. Our approach is motivated by the fact that, at any time, only a small number of application components of large multi-tier applications experience poor performance. Dealer abstracts application structure as a component graph, with nodes being application components and edges capturing inter-component communication patterns. Dealer continually monitors the performance of individual component replicas and communication latencies between replica pairs. In serving any given user request, Dealer seeks to minimize user response times by picking the best combination of replicas (potentially located across different data-centers). While Dealer does require modifications to application code, we show through integration with two multi-tier applications that the changes required are modest. Our evaluations on two multi-tier applications using real cloud deployments indicate the 90%ile of application response times could be reduced by a factor of 3 under natural cloud dynamics compared to conventional data-center redirection techniques which are agnostic of application structure.