An evaluation of zookeeper for high availability in system S

Authors:
Cuong Manh Pham;Victor Dogaru;Rohit Wagle;Chitra Venkatramani;Zbigniew Kalbarczyk;Ravishankar Iyer
Affiliations:
University of Illinois at Urbana Champaign, Urbana, IL, USA;IBM Corp., San Francisco, CA, USA;IBM Corp., Yorktown Heights, NY, USA;IBM Corp., Yorktown Heights, NY, USA;University of Illinois at Urbana-Champaign, Urbana, IL, USA;University of Illinois at Urbana-Champaign, Urbana, IL, USA
Venue:
Proceedings of the 5th ACM/SPEC international conference on Performance engineering
Year:
2014

Citing 8
Cited 0

SPC: a distributed, scalable platform for data mining

Proceedings of the 4th international workshop on Data mining standards, services and platforms
Challenges and experience in prototyping a multi-modal stream analytic and monitoring application on System S

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
SODA: an optimizing scheduler for large-scale stream-based distributed computer systems

Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware
Job Admission and Resource Allocation in Distributed Streaming Systems

Job Scheduling Strategies for Parallel Processing
ZooKeeper: wait-free coordination for internet-scale systems

USENIXATC'10 Proceedings of the 2010 USENIX conference on USENIX annual technical conference
Distributed middleware reliability and fault tolerance support in system S

Proceedings of the 5th ACM international conference on Distributed event-based system
Zab: High-performance broadcast for primary-backup systems

DSN '11 Proceedings of the 2011 IEEE/IFIP 41st International Conference on Dependable Systems&Networks
Stormy: an elastic and highly available streaming service in the cloud

Proceedings of the 2012 Joint EDBT/ICDT Workshops

Quantified Score

Hi-index	0.00

Visualization

Abstract

ZooKeeper provides scalable, highly available coordination services for distributed applications. In this paper, we evaluate the use of ZooKeeper in a distributed stream computing system called System S to provide a resilient name service, dynamic configuration management, and system state management. The evaluation shed light on the advantages of using ZooKeeper in these contexts as well as its limitations. We also describe design changes we made to handle named objects in System S to overcome the limitations. We present detailed experimental results, which we believe will be beneficial to the community.