Adaptive random sampling for load change detection

Authors:
Baek-Young Choi;Jaesung Park;Zhi-Li Zhang
Affiliations:
University of Minnesota, Minnesota MN;University of Minnesota, Minnesota MN;University of Minnesota, Minnesota MN
Venue:
SIGMETRICS '02 Proceedings of the 2002 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Year:
2002

Citing 0
Cited 13

Estimating flow distributions from sampled flow statistics

Proceedings of the 2003 conference on Applications, technologies, architectures, and protocols for computer communications
Predicting resource usage and estimation accuracy in an IP flow measurement collection infrastructure

Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement
Flow sampling under hard resource constraints

Proceedings of the joint international conference on Measurement and modeling of computer systems
Building a better NetFlow

Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications
Impact of packet sampling on anomaly detection metrics

Proceedings of the 6th ACM SIGCOMM conference on Internet measurement
On sampling self-similar internet traffic

Computer Networks: The International Journal of Computer and Telecommunications Networking
Automated Detection of Load Changes in Large-Scale Networks

TMA '09 Proceedings of the First International Workshop on Traffic Monitoring and Analysis
Entropy based adaptive flow aggregation

IEEE/ACM Transactions on Networking (TON)
Design principles and algorithms for effective high-speed IP flow monitoring

Computer Communications
Adaptive sampling measurement for high speed network traffic flow

WiCOM'09 Proceedings of the 5th International Conference on Wireless communications, networking and mobile computing
Estimation of data traffic flows from aggregate measurements

Mathematical and Computer Modelling: An International Journal
Exploiting packet-sampling measurements for traffic characterization and classification

International Journal of Network Management
Enabling free internet access at the edges of broadband connections: a hybrid packet scheduling approach

ACM SIGMOBILE Mobile Computing and Communications Review

Quantified Score

Hi-index	0.00

Visualization

Abstract

Timely detection of changes in traffic load is critical for initiating appropriate traffic engineering mechanisms. Accurate measurement of traffic is essential since the efficacy of change detection depends on the accuracy of traffic estimation. However, precise traffic measurement involves inspecting every packet traversing a link, resulting in significant overhead, particularly on high speed links. Sampling techniques for traffic load estimation are proposed as a way to limit the measurement overhead. In this paper, we address the problem of bounding sampling error within a pre-specified tolerance level and propose an adaptive random sampling technique that determines the minimum sampling probability adaptively according to traffic dynamics. Using real network traffic traces, we show that the proposed adaptive random sampling technique indeed produces the desired accuracy, while also yielding significant reduction in the amount of traffic samples. We also investigate the impact of sampling errors on the performance of load change detection.