A fault detection service for wide area distributed computations
Cluster Computing
Self-configuring network traffic generation
Proceedings of the 4th ACM SIGCOMM conference on Internet measurement
Replication for web hosting systems
ACM Computing Surveys (CSUR)
Replication for web hosting systems
ACM Computing Surveys (CSUR)
Network traffic characteristics of data centers in the wild
IMC '10 Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
Sketching the delay: tracking temporally uncorrelated flow-level latencies
Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Hi-index | 0.00 |
One of the fundamental difficulties with trying to characterize the Internet''s behavior lies in its immense diversity. To date, efforts to characterize end-to-end Internet dynamics such as packet delay and loss have studied at most a handful of traffic traces and Internet paths, making it difficult to assess the generality of the findings. Yet solid assessments of Internet path properties are crucial for engineering transport protocols for high performance. In this work, we attempt to tackle this problem using a distributed framework we developed for conducting end-to-end measurements. In the first part, we report on an end-to-end routing study conducted using the framework, in which 37 sites participated, yielding about 40,000 routing measurements along 1,000 Internet paths. We characterize routing pathologies and failures, stability over time, and symmetry. In the second part of the study, we analyze 20,000 TCP bulk transfers measured using the same framework. We discuss: 1) errors introduced by the packet filters used to make the measurements; 2) dealing with unsynchronized and skewed clocks; 3) separating out TCP behavior from network behavior; 4) the surprisingly large variations between different TCP implementations; 5) pathological network behavior, such as out-of-order delivery, replication, and corruption; 6) a robust algorithm for estimating bottleneck bandwidth; and 7) the resulting characterizations of Internet packet loss and delay, including general assessments of queueing time scales and available bandwidth.