Total order broadcast and multicast algorithms: Taxonomy and survey

Authors:
Xavier Défago;André Schiper;Péter Urbán
Affiliations:
Japan Advanced Institute of Science and Technology and PRESTO, Japan Science and Technology Agency, Ishikawa, Japan;école Polytechnique Fédérale de Lausanne, Switzerland;Japan Advanced Institute of Science and Technology, Ishikawa, Japan
Venue:
ACM Computing Surveys (CSUR)
Year:
2004

Citing 100
Cited 73

Using Time Instead of Timeout for Fault-Tolerant Distributed Systems.

ACM Transactions on Programming Languages and Systems (TOPLAS)
The mutual exclusion problem: part I—a theory of interprocess communication

Journal of the ACM (JACM)
Reliable communication in the presence of failures

ACM Transactions on Computer Systems (TOCS)
On the minimal synchronism needed for distributed consensus

Journal of the ACM (JACM)
Concurrency control and recovery in database systems

Concurrency control and recovery in database systems
Consensus in the presence of partial synchrony

Journal of the ACM (JACM)
Preserving and using context information in interprocess communication

ACM Transactions on Computer Systems (TOCS)
AMp: a highly parallel atomic multicast protocol

SIGCOMM '89 Symposium proceedings on Communications architectures & protocols
Automatically increasing the fault-tolerance of distributed algorithms

Journal of Algorithms
Synchronous atomic broadcast for redundant broadcast for redundant channels

Real-Time Systems
Implementing fault-tolerant services using the state machine approach: a tutorial

ACM Computing Surveys (CSUR)
Inconsistency and contamination (preliminary version)

PODC '91 Proceedings of the tenth annual ACM symposium on Principles of distributed computing
Reliable atomic broadcast in distributed systems with omission faults

ACM SIGOPS Operating Systems Review
Atomic broadcast in one phase

ACM SIGOPS Operating Systems Review
Ordered and reliable multicast communication

ACM Transactions on Computer Systems (TOCS)
Lightweight causal and atomic group multicast

ACM Transactions on Computer Systems (TOCS)
TOMP a total ordering multicast protocol

ACM SIGOPS Operating Systems Review
An evaluation framework for Multicast Ordering Protocols

SIGCOMM '92 Conference proceedings on Communications architectures & protocols
Asynchronous fault-tolerant total ordering algorithms

SIAM Journal on Computing
A response to Cheriton and Skeen's criticism of causal and totally ordered communication

ACM SIGOPS Operating Systems Review
Understanding the limitations of causally and totally ordered communication

SOSP '93 Proceedings of the fourteenth ACM symposium on Operating systems principles
Sequential consistency versus linearizability

ACM Transactions on Computer Systems (TOCS)
Replica determinism in distributed real-time systems: a brief survey

Real-Time Systems
Secure agreement protocols: reliable and atomic group multicast in rampart

CCS '94 Proceedings of the 2nd ACM Conference on Computer and communications security
To CATOCS or not to CATOCS, that is the …

ACM SIGOPS Operating Systems Review
A Total Ordering Multicast Protocol Using Propagation Trees

IEEE Transactions on Parallel and Distributed Systems
Atomic broadcast: from simple message diffusion to Byzantine agreement

Information and Computation
The Totem single-ring ordering and membership protocol

ACM Transactions on Computer Systems (TOCS)
Formal specification and compositional verification of an atomic broadcast protocol

Real-Time Systems
Impossibility of distributed consensus with one faulty process

Journal of the ACM (JACM)
Unreliable failure detectors for reliable distributed systems

Journal of the ACM (JACM)
Totem: a fault-tolerant multicast group communication system

Communications of the ACM
The Transis approach to high availability cluster communication

Communications of the ACM
Distributing trust with the Rampart toolkit

Communications of the ACM
From group communication to transactions in distributed systems

Communications of the ACM
The weakest failure detector for solving consensus

Journal of the ACM (JACM)
A Comment on "A Total Ordering Multicast Protocol Using Propagation Trees"

IEEE Transactions on Parallel and Distributed Systems
A Note on Total Ordering Multicast Using Propagation Trees

IEEE Transactions on Parallel and Distributed Systems
An adaptive totally ordered multicast protocol that tolerates partitions

PODC '98 Proceedings of the seventeenth annual ACM symposium on Principles of distributed computing
The Totem multiple-ring ordering and topology maintenance protocol

ACM Transactions on Computer Systems (TOCS)
Coyote: a system for constructing fine-grain configurable communication services

ACM Transactions on Computer Systems (TOCS)
Byzantine-resistant total ordering algorithms

Information and Computation
Real-Time Dependable Channels: Customizing QoS Attributes for Distributed Systems

IEEE Transactions on Parallel and Distributed Systems
The Timed Asynchronous Distributed System Model

IEEE Transactions on Parallel and Distributed Systems
Using the heartbeat failure detector for quiescent reliable communication and consensus in partitionable networks

Theoretical Computer Science
A formal method to prove ordering properties of multicast systems

ACM SIGOPS Operating Systems Review
Efficient atomic broadcast using deterministic merge

Proceedings of the nineteenth annual ACM symposium on Principles of distributed computing
On Quiescent Reliable Communication

SIAM Journal on Computing
The Byzantine Generals Problem

ACM Transactions on Programming Languages and Systems (TOPLAS)
Reliable broadcast protocols

ACM Transactions on Computer Systems (TOCS)
Time, clocks, and the ordering of events in a distributed system

Communications of the ACM
Genuine atomic multicast in asynchronous distributed systems

Theoretical Computer Science
Specifying and using a partitionable group communication service

ACM Transactions on Computer Systems (TOCS)
Group communication specifications: a comprehensive study

ACM Computing Surveys (CSUR)
Distributed Algorithms

Distributed Algorithms
Reliable Distributed Computing with the ISIS Toolkit

Reliable Distributed Computing with the ISIS Toolkit
Formal Models of Communication Services: A Case Study

Computer
Boosting System Performance with Optimistic Distributed Protocols

Computer
Consensus-Based Fault-Tolerant Total Order Multicast

IEEE Transactions on Parallel and Distributed Systems
A Fault-Tolerant Protocol for Atomic Broadcast

IEEE Transactions on Parallel and Distributed Systems
Perfect Failure Detection in Timed Asynchronous Systems

IEEE Transactions on Computers
Don't Be Lazy, Be Consistent: Postgres-R, A New Way to Implement Database Replication

VLDB '00 Proceedings of the 26th International Conference on Very Large Data Bases
Reliable Broadcast in Synchronous and Asynchronous Environments (Preliminary Version)

Proceedings of the 3rd International Workshop on Distributed Algorithms
Quick Atomic Broadcast (Extended Abstract)

WDAG '93 Proceedings of the 7th International Workshop on Distributed Algorithms
Revistiting the Relationship Between Non-Blocking Atomic Commitment and Consensus

WDAG '95 Proceedings of the 9th International Workshop on Distributed Algorithms
Genuine Atomic Multicast

WDAG '97 Proceedings of the 11th International Workshop on Distributed Algorithms
Early-Delivery Dynamic Atomic Broadcast

DISC '02 Proceedings of the 16th International Conference on Distributed Computing
Exploiting Atomic Broadcast in Replicated Databases (Extended Abstract)

Euro-Par '97 Proceedings of the Third International Euro-Par Conference on Parallel Processing
Exploiting Atomic Broadcast in Replicated Databases

Euro-Par '98 Proceedings of the 4th International Euro-Par Conference on Parallel Processing
A High Performance Totally Ordered Multicast Protocol

Selected Papers from the International Workshop on Theory and Practice in Distributed Systems
The Design of the Transis System

Selected Papers from the International Workshop on Theory and Practice in Distributed Systems
Optimistic Atomic Broadcast

DISC '98 Proceedings of the 12th International Symposium on Distributed Computing
Thrifty Generic Broadcast

DISC '00 Proceedings of the 14th International Conference on Distributed Computing
Optimistic atomic broadcast: a pragmatic viewpoint

Theoretical Computer Science - Special issue: Distributed computing
A Lightweight Solution to Uniform Atomic Broadcast for Asynchronous Systems

FTCS '97 Proceedings of the 27th International Symposium on Fault-Tolerant Computing (FTCS '97)
Another advantage of free choice (Extended Abstract): Completely asynchronous agreement protocols

PODC '83 Proceedings of the second annual ACM symposium on Principles of distributed computing
Packing Messages as a Tool for Boosting the Performance of Total Ordering Protocls

HPDC '97 Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing
Low cost consensus-based Atomic Broadcast

PRDC '00 Proceedings of the 2000 Pacific Rim International Symposium on Dependable Computing
RTCAST: lightweight multicast for real-time process groups

RTAS '96 Proceedings of the 2nd IEEE Real-Time Technology and Applications Symposium (RTAS '96)
A hierarchy of totally ordered multicasts

SRDS '95 Proceedings of the 14TH Symposium on Reliable Distributed Systems
Real-Time Fault-Tolerant Atomic Broadcast

SRDS '99 Proceedings of the 18th IEEE Symposium on Reliable Distributed Systems
Optimistic Total Order in Wide Area Networks

SRDS '02 Proceedings of the 21st IEEE Symposium on Reliable Distributed Systems
Probabilistic Atomic Broadcast

SRDS '02 Proceedings of the 21st IEEE Symposium on Reliable Distributed Systems
An Indulgent Uniform Total Order Algorithm with Optimistic Delivery

SRDS '02 Proceedings of the 21st IEEE Symposium on Reliable Distributed Systems
Scalable Atomic Multicast

IC3N '98 Proceedings of the International Conference on Computer Communications and Networks
An evaluation of the Amoeba group communication system

ICDCS '96 Proceedings of the 16th International Conference on Distributed Computing Systems (ICDCS '96)
Reservation-based totally ordered multicasting

ICDCS '96 Proceedings of the 16th International Conference on Distributed Computing Systems (ICDCS '96)
Totally ordered multicast in large-scale systems

ICDCS '96 Proceedings of the 16th International Conference on Distributed Computing Systems (ICDCS '96)
Efficient Ordered Brodacasting in Reliable CSMA/CD Networks

ICDCS '98 Proceedings of the The 18th International Conference on Distributed Computing Systems
Understanding Replication in Databases and Distributed Systems

ICDCS '00 Proceedings of the The 20th International Conference on Distributed Computing Systems ( ICDCS 2000)
Atomic Broadcast in Asynchronous Crash-Recovery Distributed Systems

ICDCS '00 Proceedings of the The 20th International Conference on Distributed Computing Systems ( ICDCS 2000)
Using Optimistic Atomic Broadcast in Transaction Processing Systems

IEEE Transactions on Knowledge and Data Engineering
A Modular Approach to Fault-Tolerant Broadcasts and Related Problems

A Modular Approach to Fault-Tolerant Broadcasts and Related Problems
Backoff Protocols for Distributed Mutual Exclusion and Ordering

ICDCS '01 Proceedings of the The 21st International Conference on Distributed Computing Systems
Optimistic Active Replication

ICDCS '01 Proceedings of the The 21st International Conference on Distributed Computing Systems
Protocol Switching: Exploiting Meta-Properties

ICDCSW '01 Proceedings of the 21st International Conference on Distributed Computing Systems
Newtop: a fault-tolerant group communication protocol

ICDCS '95 Proceedings of the 15th International Conference on Distributed Computing Systems
Processing Transactions over Optimistic Atomic Broadcast Protocols

ICDCS '99 Proceedings of the 19th IEEE International Conference on Distributed Computing Systems
Token-based Atomic Broadcast using Unreliable Failure Detectors

SRDS '04 Proceedings of the 23rd IEEE International Symposium on Reliable Distributed Systems
Handling message semantics with Generic Broadcast protocols

Distributed Computing

MIDDLE-R: Consistent database replication at the middleware level

ACM Transactions on Computer Systems (TOCS)
MOLAR: adaptive runtime support for high-end computing operating and runtime systems

ACM SIGOPS Operating Systems Review
A classification of total order specifications and its application to fixed sequencer-based implementations

Journal of Parallel and Distributed Computing
Message-ordered multicast by common building blocks

InfoScale '06 Proceedings of the 1st international conference on Scalable information systems
Scalable, fault tolerant membership for MPI tasks on HPC systems

Proceedings of the 20th annual international conference on Supercomputing
A survey of autonomic communications

ACM Transactions on Autonomous and Adaptive Systems (TAAS)
Sinfonia: a new paradigm for building scalable distributed systems

Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles
The co-replication methodology and its application to structured parallel programs

Proceedings of the 2007 symposium on Component and framework technology in high-performance and scientific computing
Supporting amnesia in log-based recovery protocols

EATIS '07 Proceedings of the 2007 Euro American conference on Telematics and information systems
Optimistic transactional active replication

Proceedings of the 2nd international conference on Ubiquitous information management and communication
SIPRe: a partial database replication protocol with SI replicas

Proceedings of the 2008 ACM symposium on Applied computing
Disaster avoidance mechanism for content-delivering service

Computers and Operations Research
Reducing Transaction Abort Rates with Prioritized Atomic Multicast Protocols

Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Multicast survivability in hierarchical broadcast networks

WSEAS TRANSACTIONS on COMMUNICATIONS
Solving Atomic Multicast When Groups Crash

OPODIS '08 Proceedings of the 12th International Conference on Principles of Distributed Systems
Decentralized message ordering for publish/subscribe systems

Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware
A simple totally ordered broadcast protocol

LADIS '08 Proceedings of the 2nd Workshop on Large-Scale Distributed Systems and Middleware
Towards distributed software transactional memory systems

LADIS '08 Proceedings of the 2nd Workshop on Large-Scale Distributed Systems and Middleware
Formal Development of a Total Order Broadcast for Distributed Transactions Using Event-B

Methods, Models and Tools for Fault Tolerance
Group Abstractions for Organizing Dynamic Distributed Systems

Euro-Par 2008 Workshops - Parallel Processing
A Generic Group Communication Approach for Hybrid Distributed Systems

DAIS '09 Proceedings of the 9th IFIP WG 6.1 International Conference on Distributed Applications and Interoperable Systems
Proactive Peer-to-Peer Traffic Control When Delivering Large Amounts of Content within a Large-Scale Organization

NEW2AN '09 and ruSMART '09 Proceedings of the 9th International Conference on Smart Spaces and Next Generation Wired/Wireless Networking and Second Conference on Smart Spaces
Downward communications enhancement using a robust broadcasting mechanism

Expert Systems with Applications: An International Journal
Sinfonia: A new paradigm for building scalable distributed systems

ACM Transactions on Computer Systems (TOCS)
Symmetric active/active metadata service for high availability parallel file systems

Journal of Parallel and Distributed Computing
Symmetric active/active metadata service for highly available cluster storage systems

PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
A formal analysis of database replication protocols with SI replicas and crash failures

The Journal of Supercomputing
Smart meeting systems: A survey of state-of-the-art and open issues

ACM Computing Surveys (CSUR)
On the Cost of Prioritized Atomic Multicast Protocols

OTM '09 Proceedings of the Confederated International Conferences, CoopIS, DOA, IS, and ODBASE 2009 on On the Move to Meaningful Internet Systems: Part I
Fault-management in P2P-MPI

International Journal of Parallel Programming
Rigorous analysis of byzantine causal order using Event-B

Proceedings of the International Conference and Workshop on Emerging Trends in Technology
Unconscious eventual consistency with gossips

SSS'06 Proceedings of the 8th international conference on Stabilization, safety, and security of distributed systems
Fast, flexible, and highly resilient genuine fifo and causal multicast algorithms

Proceedings of the 2010 ACM Symposium on Applied Computing
On the inherent cost of atomic broadcast and multicast in wide area networks

ICDCN'08 Proceedings of the 9th international conference on Distributed computing and networking
Throughput optimal total order broadcast for cluster environments

ACM Transactions on Computer Systems (TOCS)
Atomic mobile agent group communication

CCNC'10 Proceedings of the 7th IEEE conference on Consumer communications and networking conference
Mencius: building efficient replicated state machines for WANs

OSDI'08 Proceedings of the 8th USENIX conference on Operating systems design and implementation
vNUMA: a virtual shared-memory multiprocessor

USENIX'09 Proceedings of the 2009 conference on USENIX Annual technical conference
Generic replication of software transactional memory

Proceedings of the 7th Middleware Doctoral Symposium
Wire-speed total order

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Ricochet: lateral error correction for time-critical multicast

NSDI'07 Proceedings of the 4th USENIX conference on Networked systems design & implementation
SCert: Speculative certification in replicated software transactional memories

Proceedings of the 4th Annual International Conference on Systems and Storage
Asynchronous lease-based replication of software transactional memory

Proceedings of the ACM/IFIP/USENIX 11th International Conference on Middleware
Poster: selftuning batching in total order broadcast via analytical modelling and reinforcement learning

ACM SIGMETRICS Performance Evaluation Review - Special Issue on IFIP PERFORMANCE 2011- 29th International Symposium on Computer Performance, Modeling, Measurement and Evaluation
A robust web-based approach for broadcasting downward messages in a large-scaled company

WISE'06 Proceedings of the 7th international conference on Web Information Systems
Decentralized message ordering for publish/subscribe systems

Middleware'06 Proceedings of the 7th ACM/IFIP/USENIX international conference on Middleware
Integrating the ROMIOP and ETF specifications for atomic multicast in CORBA

OTM'05 Proceedings of the 2005 Confederated international conference on On the Move to Meaningful Internet Systems - Volume >Part I
Group communication: from practice to theory

SOFSEM'06 Proceedings of the 32nd conference on Current Trends in Theory and Practice of Computer Science
Run-time switching between total order algorithms

Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
Low-latency atomic broadcast in the presence of contention

DISC'06 Proceedings of the 20th international conference on Distributed Computing
Optimistic generic broadcast

DISC'05 Proceedings of the 19th international conference on Distributed Computing
Dependable systems

Dependable Systems
TM2C: a software transactional memory for many-cores

Proceedings of the 7th ACM european conference on Computer Systems
Modular approach to replication for availability

Replication
State machine replication with byzantine faults

Replication
Practical database replication

Replication
Proof and evaluation of a 1CS middleware data replication protocol based on O2PL

ISPA'06 Proceedings of the 4th international conference on Parallel and Distributed Processing and Applications
Tuning paxos for high-throughput with batching and pipelining

ICDCN'12 Proceedings of the 13th international conference on Distributed Computing and Networking
Batched transactions for RESTful web services

ICWE'11 Proceedings of the 11th international conference on Current Trends in Web Engineering
FAIDECS: fair decentralized event correlation

Middleware'11 Proceedings of the 12th ACM/IFIP/USENIX international conference on Middleware
Formal development of byzantine immune total order broadcast system using event-b

ICDEM'10 Proceedings of the Second international conference on Data Engineering and Management
Consistency and fault tolerance for erasure-coded distributed storage systems

Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date
Optimistic Scheduling with Geographically Replicated Services in the Cloud Environment (COLOR)

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Serializability, not serial: concurrency control and availability in multi-datacenter datastores

Proceedings of the VLDB Endowment
Language expressiveness and quality of service for publish/subscribe systems

Proceedings of the 9th Middleware Doctoral Symposium of the 13th ACM/IFIP/USENIX International Middleware Conference
FAIDECS: fair decentralized event correlation

Proceedings of the 12th International Middleware Conference
Enhancing group communication with self-manageable behavior

Journal of Parallel and Distributed Computing
SCORe: a scalable one-copy serializable partial replication protocol

Proceedings of the 13th International Middleware Conference
Avoiding disruptive failovers in transaction processing systems with multiple active nodes

Journal of Parallel and Distributed Computing
Optimizing Paxos with batching and pipelining

Theoretical Computer Science
Consistency without borders

Proceedings of the 4th annual Symposium on Cloud Computing
CORFU: A distributed shared log

ACM Transactions on Computer Systems (TOCS)
Scalable service-oriented replication with flexible consistency guarantee in the cloud

Information Sciences: an International Journal

Quantified Score

Hi-index	0.01

Visualization

Abstract

Total order broadcast and multicast (also called atomic broadcast/multicast) present an important problem in distributed systems, especially with respect to fault-tolerance. In short, the primitive ensures that messages sent to a set of processes are, in turn, delivered by all those processes in the same total order.