Studying black holes in the internet with Hubble

Authors:
Ethan Katz-Bassett;Harsha V. Madhyastha;John P. John;Arvind Krishnamurthy;David Wetherall;Thomas Anderson
Affiliations:
Dept. of Computer Science, Univ. of Washington, Seattle;Dept. of Computer Science, Univ. of Washington, Seattle;Dept. of Computer Science, Univ. of Washington, Seattle;Dept. of Computer Science, Univ. of Washington, Seattle;Univ. of Washington and Intel Research;Dept. of Computer Science, Univ. of Washington, Seattle
Venue:
NSDI'08 Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation
Year:
2008

Citing 23
Cited 36

The design philosophy of the DARPA internet protocols

SIGCOMM '88 Symposium proceedings on Communications architectures and protocols
End-to-end routing behavior in the Internet

IEEE/ACM Transactions on Networking (TON)
Delayed Internet routing convergence

Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication
Resilient overlay networks

SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
An analysis of BGP multiple origin AS (MOAS) conflicts

IMW '01 Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement
Understanding BGP misconfiguration

Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications
Measuring the effects of internet path faults on reactive routing

SIGMETRICS '03 Proceedings of the 2003 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
BGP beacons

Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement
Locating internet routing instabilities

Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications
A measurement framework for pin-pointing routing changes

Proceedings of the ACM SIGCOMM workshop on Network troubleshooting: research, theory and operations practice meet malfunctioning reality
DIMES: let the internet measure itself

ACM SIGCOMM Computer Communication Review
A measurement study on the impact of routing events on end-to-end internet path performance

Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications
Can you hear me now?!: it must be BGP

ACM SIGCOMM Computer Communication Review
OSPF monitoring: architecture, design and deployment experience

NSDI'04 Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation - Volume 1
Finding a needle in a haystack: pinpointing significant BGP routing changes in an IP network

NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
Detecting BGP configuration faults with static analysis

NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
IP fault localization via risk modeling

NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
PlanetSeer: internet path failure monitoring and characterization in wide-area services

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Improving the reliability of internet paths with one-hop source routing

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Diagnosing network disruptions with network-wide analysis

Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
iPlane: an information plane for distributed services

OSDI '06 Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation - Volume 7
Testing the reachability of (new) address space

Proceedings of the 2007 SIGCOMM workshop on Internet network management
NetDiagnoser: troubleshooting network unreachabilities using end-to-end probes and routing data

CoNEXT '07 Proceedings of the 2007 ACM CoNEXT conference

Effective diagnosis of routing disruptions from end systems

NSDI'08 Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation
Ispy: detecting ip prefix hijacking on my own

Proceedings of the ACM SIGCOMM 2008 conference on Data communication
Practical issues with using network tomography for fault diagnosis

ACM SIGCOMM Computer Communication Review
Traceroute probe method and forward IP path inference

Proceedings of the 8th ACM SIGCOMM conference on Internet measurement
Analyzing Router Responsiveness to Active Measurement Probes

PAM '09 Proceedings of the 10th International Conference on Passive and Active Network Measurement
iPlane Nano: path prediction for peer-to-peer applications

NSDI'09 Proceedings of the 6th USENIX symposium on Networked systems design and implementation
The workshop on active internet measurements (AIMS) report

ACM SIGCOMM Computer Communication Review
Moving beyond end-to-end path information to optimize CDN performance

Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference
Measurement methods for fast and accurate blackhole identification with binary tomography

Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference
Region-based BGP announcement filtering for improved BGP security

ASIACCS '10 Proceedings of the 5th ACM Symposium on Information, Computer and Communications Security
Predicting prefix availability in the internet

INFOCOM'10 Proceedings of the 29th conference on Information communications
Crowdsourcing service-level network event monitoring

Proceedings of the ACM SIGCOMM 2010 conference
Reverse traceroute

NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
Resolving IP aliases with prespecified timestamps

IMC '10 Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
Verifiable network-performance measurements

Proceedings of the 6th International COnference
Prediction models for long-term Internet prefix availability

Computer Networks: The International Journal of Computer and Telecommunications Networking
iSPY: detecting IP prefix hijacking on my own

IEEE/ACM Transactions on Networking (TON)
FACT: flow-based approach for connectivity tracking

PAM'11 Proceedings of the 12th international conference on Passive and active measurement
Predicting and tracking internet path changes

Proceedings of the ACM SIGCOMM 2011 conference
Analysis of country-wide internet outages caused by censorship

Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Machiavellian routing: improving internet availability with BGP poisoning

Proceedings of the 10th ACM Workshop on Hot Topics in Networks
On route aggregation

Proceedings of the Seventh COnference on emerging Networking EXperiments and Technologies
Extracting benefit from harm: using malware pollution to analyze the impact of political and geophysical events on the internet

ACM SIGCOMM Computer Communication Review
End-user perspectives of Internet connectivity problems

Computer Networks: The International Journal of Computer and Telecommunications Networking
LIFEGUARD: practical repair of persistent route failures

Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication
LIFEGUARD: practical repair of persistent route failures

ACM SIGCOMM Computer Communication Review - Special october issue SIGCOMM '12
Detecting prefix hijackings in the internet with argus

Proceedings of the 2012 ACM conference on Internet measurement conference
Classifying internet one-way traffic

Proceedings of the 2012 ACM conference on Internet measurement conference
Understanding the latency benefits of multi-cloud webservice deployments

ACM SIGCOMM Computer Communication Review
Towards active measurements of edge network outages

PAM'13 Proceedings of the 14th international conference on Passive and Active Measurement
Trinocular: understanding internet reliability through adaptive probing

Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
PoiRoot: investigating the root cause of interdomain path changes

Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
RiskRoute: a framework for mitigating network outage threats

Proceedings of the ninth ACM conference on Emerging networking experiments and technologies
Federated flow-based approach for privacy preserving connectivity tracking

Proceedings of the ninth ACM conference on Emerging networking experiments and technologies
Answering why-not queries in software-defined networks with negative provenance

Proceedings of the Twelfth ACM Workshop on Hot Topics in Networks
Visualizing sparse internet events: network outages and route changes

Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present Hubble, a system that operates continuously to find Internet reachability problems in which routes exist to a destination but packets are unable to reach the destination. Hubble monitors at a 15 minute granularity the data-path to prefixes that cover 89% of the Internet's edge address space. Key enabling techniques include a hybrid passive/active monitoring approach and the synthesis of multiple information sources that include historical data. With these techniques, we estimate that Hubble discovers 85% of the reachability problems that would be found with a pervasive probing approach, while issuing only 5.5% as many probes. We also present the results of a three week study conducted with Hubble. We find that the extent of reachability problems, both in number and duration, is much greater than we expected, with problems persisting for hours and even days, and many of the problems do not correlate with BGP updates. In many cases, a multi-homed AS is reachable through one provider, but probes through another terminate; using spoofed packets, we isolated the direction of failure in 84% of cases we analyzed and found all problems to be exclusively on the forward path from the provider to the destination. A snapshot of the problems Hubble is currently monitoring can be found at http://hubble.cs.washington.edu.