Random early detection gateways for congestion avoidance
IEEE/ACM Transactions on Networking (TON)
End-to-end Internet packet dynamics
SIGCOMM '97 Proceedings of the ACM SIGCOMM '97 conference on Applications, technologies, architectures, and protocols for computer communication
Applied numerical linear algebra
Applied numerical linear algebra
End-to-end routing behavior in the Internet
IEEE/ACM Transactions on Networking (TON)
On power-law relationships of the Internet topology
Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication
LAPACK Users' guide (third ed.)
LAPACK Users' guide (third ed.)
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
IDMaps: a global internet host distance estimation service
IEEE/ACM Transactions on Networking (TON)
On the constancy of internet path properties
IMW '01 Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement
On the origin of power laws in Internet topologies
ACM SIGCOMM Computer Communication Review
Network tomography on general topologies
SIGMETRICS '02 Proceedings of the 2002 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Detecting shared congestion of flows via end-to-end measurement
IEEE/ACM Transactions on Networking (TON)
On the stability of network distance estimation
ACM SIGMETRICS Performance Evaluation Review
Managing End-to-End Network Performance via Optimized Monitoring Strategies
Journal of Network and Systems Management
Measuring ISP topologies with rocketfuel
Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications
Network topology generators: degree-based vs. structural
Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications
Tomography-based overlay network monitoring
Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement
On the Cost-Quality Tradeoff in Topology-Aware Overlay Path Probing
ICNP '03 Proceedings of the 11th IEEE International Conference on Network Protocols
Towards a scalable, adaptive and network-aware content distribution network
Towards a scalable, adaptive and network-aware content distribution network
Multicast-based inference of network-internal loss characteristics
IEEE Transactions on Information Theory
Multicast-based loss inference with missing data
IEEE Journal on Selected Areas in Communications
Support for service composition in i3
Proceedings of the 12th annual ACM international conference on Multimedia
Lessons from resource allocators for large-scale multiuser testbeds
ACM SIGOPS Operating Systems Review
Oasis: an overlay-aware network stack
ACM SIGOPS Operating Systems Review
NetQuest: a flexible framework for large-scale network measurement
SIGMETRICS '06/Performance '06 Proceedings of the joint international conference on Measurement and modeling of computer systems
Towards deterministic network diagnosis
SIGMETRICS '06/Performance '06 Proceedings of the joint international conference on Measurement and modeling of computer systems
Dynamic overlay routing based on available bandwidth estimation: a simulation study
Computer Networks: The International Journal of Computer and Telecommunications Networking - Overlay distribution structures and their applications
Towards unbiased end-to-end network diagnosis
Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications
S3: a scalable sensing service for monitoring large networked systems
Proceedings of the 2006 SIGCOMM workshop on Internet network management
Topology-aware overlay path probing
Computer Communications
Accurate and efficient SLA compliance monitoring
Proceedings of the 2007 conference on Applications, technologies, architectures, and protocols for computer communications
Identifying lossy links in wired/wireless networks by exploiting sparse characteristics
Computer Networks: The International Journal of Computer and Telecommunications Networking
Network loss inference with second order statistics of end-to-end flows
Proceedings of the 7th ACM SIGCOMM conference on Internet measurement
Compressed network monitoring for ip and all-optical networks
Proceedings of the 7th ACM SIGCOMM conference on Internet measurement
iPlane: an information plane for distributed services
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
Online linear optimization and adaptive routing
Journal of Computer and System Sciences
Link stress reduction in topology-aware overlay path monitoring
Computer Communications
Design and implementation trade-offs for wide-area resource discovery
ACM Transactions on Internet Technology (TOIT)
Network exception handlers: host-network control in enterprise networks
Proceedings of the ACM SIGCOMM 2008 conference on Data communication
Scheduling algorithms for conducting conflict-free measurements in overlay networks
Computer Networks: The International Journal of Computer and Telecommunications Networking
UFO: a resilient layered routing architecture
ACM SIGCOMM Computer Communication Review
NetQuest: a flexible framework for large-scale network measurement
IEEE/ACM Transactions on Networking (TON)
Packet doppler: network monitoring using packet shift detection
CoNEXT '08 Proceedings of the 2008 ACM CoNEXT Conference
Every microsecond counts: tracking fine-grain latencies with a lossy difference aggregator
Proceedings of the ACM SIGCOMM 2009 conference on Data communication
Sampling biases in network path measurements and what to do about it
Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference
Dynamic overlay routing based on available bandwidth estimation: A simulation study
Computer Networks: The International Journal of Computer and Telecommunications Networking - Overlay distribution structures and their applications
mPlane: an architecture for scalable fault localization
Proceedings of the 2009 workshop on Re-architecting the internet
Towards unbiased end-to-end network diagnosis
IEEE/ACM Transactions on Networking (TON)
Drafting behind Akamai: inferring network conditions based on CDN redirections
IEEE/ACM Transactions on Networking (TON)
Scalable diagnosis in IP networks using path-based measurement and inference: A learning framework
Journal of Visual Communication and Image Representation
Multiobjective monitoring for SLA compliance
IEEE/ACM Transactions on Networking (TON)
ICC'09 Proceedings of the 2009 IEEE international conference on Communications
A survey on the design, applications, and enhancements of application-layer overlay networks
ACM Computing Surveys (CSUR)
Two samples are enough: opportunistic flow-level latency estimation using netflow
INFOCOM'10 Proceedings of the 29th conference on Information communications
Proceedings of the ACM SIGCOMM 2010 conference
NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
Enabling flow-level latency measurements across routers in data centers
Hot-ICE'11 Proceedings of the 11th USENIX conference on Hot topics in management of internet, cloud, and enterprise networks and services
OLIC: online information compression for scalable hosting infrastructure monitoring
Proceedings of the Nineteenth International Workshop on Quality of Service
On using network tomography for overlay availability
ICDCN'10 Proceedings of the 11th international conference on Distributed computing and networking
On delays in management frameworks: metrics, models and analysis
DSOM'06 Proceedings of the 17th IFIP/IEEE international conference on Distributed Systems: operations and management
An efficient overlay link performance monitoring technique
NETWORKING'06 Proceedings of the 5th international IFIP-TC6 conference on Networking Technologies, Services, and Protocols; Performance of Computer and Communication Networks; Mobile and Wireless Communications Systems
Scalable deterministic end-to-end probing and analytical method for overlay network monitoring
Proceedings of the 7th International Conference on Network and Services Management
A probe prediction approach to overlay network monitoring
Proceedings of the 7th International Conference on Network and Services Management
Binary versus analogue path monitoring in IP networks
PAM'05 Proceedings of the 6th international conference on Passive and Active Network Measurement
A p2p-based framework for distributed network management
EURO-NGI'05 Proceedings of the Second international conference on Wireless Systems and Network Architectures in Next Generation Internet
Opportunistic flow-level latency estimation using consistent netflow
IEEE/ACM Transactions on Networking (TON)
Sparsity without the complexity: loss localisation using tree measurements
IFIP'12 Proceedings of the 11th international IFIP TC 6 conference on Networking - Volume Part I
Router support for fine-grained latency measurements
IEEE/ACM Transactions on Networking (TON)
On identifying additive link metrics using linearly independent cycles and paths
IEEE/ACM Transactions on Networking (TON)
MAPLE: a scalable architecture for maintaining packet latency measurements
Proceedings of the 2012 ACM conference on Internet measurement conference
Efficient Loss Inference Algorithm Using Unicast End-to-End Measurements
Journal of Network and Systems Management
Routing topology inference for wireless sensor networks
ACM SIGCOMM Computer Communication Review
Fine-grain diagnosis of overlay performance anomalies using end-point network experiences
Proceedings of the 8th International Conference on Network and Service Management
Identifiability of link metrics based on end-to-end path measurements
Proceedings of the 2013 conference on Internet measurement conference
DMFSGD: a decentralized matrix factorization algorithm for network distance prediction
IEEE/ACM Transactions on Networking (TON)
High-fidelity per-flow delay measurements with reference latency interpolation
IEEE/ACM Transactions on Networking (TON)
Hi-index | 0.00 |
Overlay network monitoring enables distributed Internet applications to detect and recover from path outages and periods of degraded performance within seconds. For an overlay network with n end hosts, existing systems either require O(n2) measurements, and thus lack scalability, or can only estimate the latency but not congestion or failures. Our earlier extended abstract [1] briefly proposes an algebraic approach that selectively monitors k linearly independent paths that can fully describe all the O(n2) paths. The loss rates and latency of these k paths can be used to estimate the loss rates and latency of all other paths. Our scheme only assumes knowledge of the underlying IP topology, with links dynamically varying between lossy and normal.In this paper, we improve, implement and extensively evaluate such a monitoring system. We further make the following contributions: i) scalability analysis indicating that for reasonably large n (e.g., 100), the growth of k is bounded as O(n log n), ii) efficient adaptation algorithms for topology changes, such as the addition or removal of end hosts and routing changes, iii) measurement load balancing schemes, and iv) topology measurement error handling. Both simulation and Internet experiments demonstrate we obtain highly accurate path loss rate estimation while adapting to topology changes within seconds and handling topology errors.