HACC: an architecture for cluster-based web servers

Authors:
Xiaolan Zhang;Michael Barrientos;J. Bradley Chen;Margo Seltzer
Affiliations:
Division of Engineering and Applied Sciences, Harvard University;Division of Engineering and Applied Sciences, Harvard University;Division of Engineering and Applied Sciences, Harvard University;Division of Engineering and Applied Sciences, Harvard University
Venue:
WINSYM'99 Proceedings of the 3rd conference on USENIX Windows NT Symposium - Volume 3
Year:
1999

Citing 8
Cited 24

Process control and scheduling issues for multiprogrammed shared-memory multiprocessors

SOSP '89 Proceedings of the twelfth ACM symposium on Operating systems principles
The implications of cache affinity on processor scheduling for multiprogrammed, shared memory multiprocessors

SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
Cluster-based scalable network services

Proceedings of the sixteenth ACM symposium on Operating systems principles
Locality-aware request distribution in cluster-based network servers

Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
ASP in a Nutshell

ASP in a Nutshell
NCSA's World Wide Web Server: Design and Performance

Computer
Using Processor-Cache Affinity Information in Shared-Memory Multiprocessor Scheduling

IEEE Transactions on Parallel and Distributed Systems
A scalable and highly available web server

COMPCON '96 Proceedings of the 41st IEEE International Computer Conference

A client-aware dispatching algorithm for web clusters providing multiple services

Proceedings of the 10th international conference on World Wide Web
The state of the art in locally distributed Web-server systems

ACM Computing Surveys (CSUR)
Content-Aware Dispatching Algorithms for Cluster-Based Web Servers

Cluster Computing
Affinity-based management of main memory database clusters

ACM Transactions on Internet Technology (TOIT)
Enforcing Resource Sharing Agreements among Distributed Server Clusters

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Handling Multiple Bottlenecks in Web Servers Using Adaptive Inbound Controls

PIHSN '02 Proceedings of the 7th IFIP/IEEE International Workshop on Protocols for High Speed Networks
Ninja: A Framework for Network Services

ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
Modular TCP Handoff Design in STREAMS-Based TCP/IP Implementation

ICN '01 Proceedings of the First International Conference on Networking-Part 2
Content-Adaptive Request Distribution Strategy for Internet Server Cluster

AISA '02 Proceedings of the First International Workshop on Advanced Internet Services and Applications
The case for power management in web servers

Power aware computing
Cyclone: A High-Performance Cluster-Based Web Server with Socket Cloning

Cluster Computing
Using service brokers for accessing backend servers for web applications

Journal of Network and Computer Applications
A Comparative Evaluation of Transparent Scaling Techniques for Dynamic Content Servers

ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Weblins: a scalable WWW cluster-based server

Advances in Engineering Software
Architecting Web sites for high performance

Scientific Programming
Conflict-aware scheduling for dynamic content applications

USITS'03 Proceedings of the 4th conference on USENIX Symposium on Internet Technologies and Systems - Volume 4
Scalable content-aware request distribution in cluster-based networks servers

ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
Online Web Cluster Capacity Estimation and Its Application to Energy Conservation

IEEE Transactions on Parallel and Distributed Systems
Tashkent+: memory-aware load balancing and update filtering in replicated databases

Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Design and implementation of an efficient web cluster with content-based request distribution and file caching

Journal of Systems and Software
Specification and implementation of dynamic web site benchmark in telecommunication area

ICCOMP'08 Proceedings of the 12th WSEAS international conference on Computers
Weblins: A scalable WWW cluster-based server

Advances in Engineering Software
An up-to-date survey in web load balancing

World Wide Web
Content-Based distribution for load sharing in locally clustered web servers

ADVIS'04 Proceedings of the Third international conference on Advances in Information Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the design, implementation, and performance of the Harvard Array of Clustered Computers (HACC), a cluster-based design for scalable, cost-effective web servers. HACC is designed for locality enhancement. Requests that arrive at the cluster are distributed among the nodes so as to enhance the locality of reference that occurs on individual nodes in the cluster. By improving locality on individual cluster nodes, we can reduce their working set sizes and achieve superior performance for less cost than conventional approaches. We implemented HACC on Windows NT 4.0 and evaluated its performance for both static documents and workloads of dynamically generated documents adapted from logs of commercial web servers. Our performance results show that HACC's locality enhancement can improve performance by up to 121% for our stochastically generated static file case, by up to 40% for our trace-based static file case, and by up to 52% for our trace-based dynamic document case, compared to an IP-Sprayer approach to building cluster-based web servers.