Stream combination: adaptive IO scheduling for streaming servers

Authors:
Bin Liu;Raju Rangaswami;Zoran Dimitrijevic
Affiliations:
School of Computing and Information Sciences, Florida International University, Miami, FL;School of Computing and Information Sciences, Florida International University, Miami, FL;Google, Inc., Mountain View, CA and University of California, Santa Barbara
Venue:
ACM SIGBED Review - Special issue: The work-in-progress (WIP) session of the RTSS 2005
Year:
2006

Citing 8
Cited 1

Disk scheduling in a multimedia I/O system

MULTIMEDIA '93 Proceedings of the first ACM international conference on Multimedia
Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment

Journal of the ACM (JACM)
Effective Memory Use in a Media Server

VLDB '97 Proceedings of the 23rd International Conference on Very Large Data Bases
A Low-Cost Storage Server for Movie on Demand Databases

VLDB '94 Proceedings of the 20th International Conference on Very Large Data Bases
Real-time filesystems. Guaranteeing timing constraints for disk accesses in RT-Mach

RTSS '97 Proceedings of the 18th IEEE Real-Time Systems Symposium
Deconstructing the Kazaa Network

WIAPP '03 Proceedings of the The Third IEEE Workshop on Internet Applications
Storage Access Support for Soft Real-Time Applications

RTAS '04 Proceedings of the 10th IEEE Real-Time and Embedded Technology and Applications Symposium
Design and Implementation of Semi-preemptible IO

FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies

Building MEMS-based storage systems for streaming media

ACM Transactions on Storage (TOS)

Quantified Score

Hi-index	0.00

Visualization

Abstract

Cycle-based IO schedulers use statically configured time-cycle durations. As a result, they are unable to avoid the formation of virtual bottlenecks. We term a bottleneck as virtual when it occurs within a single resource subsystem, and it is possible to use a secondary under-utilized resource to thwart the bottleneck. The primary reason for virtual bottlenecks in streaming servers is static allocation of memory and disk-bandwidth resources using fixed time-cycle durations. As a result, shifting request workload can cause a virtual bottleneck either in the memory or disk subsystem. We present stream combination, an adaptive IO scheduling technique that addresses this problem in a comprehensive fashion. Stream combination predicts the formation of virtual bottlenecks and proactively alters the IO schedule to avoid them. A simulation study suggests significant performance gains compared to the current state-of-the-art fixed time-cycle IO scheduler.