Distributed programming in Argus
Communications of the ACM
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
A case for redundant arrays of inexpensive disks (RAID)
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
A benchmark of NonStop SQL on the debit credit transaction
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
A performance analysis of the gamma database machine
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
ACM Transactions on Computer Systems (TOCS)
Implementing fault-tolerant services using the state machine approach: a tutorial
ACM Computing Surveys (CSUR)
Encapsulation of parallelism in the Volcano query processing system
SIGMOD '90 Proceedings of the 1990 ACM SIGMOD international conference on Management of data
SIGMETRICS '90 Proceedings of the 1990 ACM SIGMETRICS conference on Measurement and modeling of computer systems
A comparison of sorting algorithms for the connection machine CM-2
SPAA '91 Proceedings of the third annual ACM symposium on Parallel algorithms and architectures
The ISIS project: real experience with a fault tolerant programming system
ACM SIGOPS Operating Systems Review
Orca: A Language for Parallel Programming of Distributed Systems
IEEE Transactions on Software Engineering
Parallel database systems: the future of high performance database systems
Communications of the ACM
SPLASH: Stanford parallel applications for shared-memory
ACM SIGARCH Computer Architecture News
Redundant disk arrays: reliable, parallel secondary storage
Redundant disk arrays: reliable, parallel secondary storage
The impact of operating system structure on memory system performance
SOSP '93 Proceedings of the fourteenth ACM symposium on Operating systems principles
RAID: high-performance, reliable secondary storage
ACM Computing Surveys (CSUR)
Loading databases using dataflow parallelism
ACM SIGMOD Record
IBM Systems Journal
Cilk: an efficient multithreaded runtime system
PPOPP '95 Proceedings of the fifth ACM SIGPLAN symposium on Principles and practice of parallel programming
The interaction of parallel and sequential workloads on a network of workstations
Proceedings of the 1995 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
Hypervisor-based fault tolerance
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
U-Net: a user-level network interface for parallel and distributed computing
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
A comparison of architectural support for messaging in the TMC CM-5 and the Cray T3D
ISCA '95 Proceedings of the 22nd annual international symposium on Computer architecture
PPFS: a high performance portable parallel file system
ICS '95 Proceedings of the 9th international conference on Supercomputing
Parallel randomized load balancing
STOC '95 Proceedings of the twenty-seventh annual ACM symposium on Theory of computing
The Vesta parallel file system
ACM Transactions on Computer Systems (TOCS)
Petal: distributed virtual disks
Proceedings of the seventh international conference on Architectural support for programming languages and operating systems
The galley parallel file system
ICS '96 Proceedings of the 10th international conference on Supercomputing
Portable library support for irregular applications
Portable library support for irregular applications
Lazy threads: implementing a fast parallel call
Journal of Parallel and Distributed Computing - Special issue on multithreading for multiprocessors
Multidimensional array I/O in Panda 1.0
The Journal of Supercomputing
SPIFFI-A Scalable Parallel File System for the Intel Paragon
IEEE Transactions on Parallel and Distributed Systems
High-performance sorting on networks of workstations
SIGMOD '97 Proceedings of the 1997 ACM SIGMOD international conference on Management of data
Cluster-based scalable network services
Proceedings of the sixteenth ACM symposium on Operating systems principles
Improving the performance of log-structured file systems with adaptive methods
Proceedings of the sixteenth ACM symposium on Operating systems principles
Cluster I/O with River: making the fast case common
Proceedings of the sixth workshop on I/O in parallel and distributed systems
Efficient input and output for scientific simulations
Proceedings of the sixth workshop on I/O in parallel and distributed systems
ACM Transactions on Computer Systems (TOCS)
Eddies: continuously adaptive query processing
SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
A relational model of data for large shared data banks
Communications of the ACM
Implicit coscheduling: coordinated scheduling with implicit information in distributed systems
ACM Transactions on Computer Systems (TOCS)
ParSets for parallelizing OODBMS traversals: implementation and performance
PDIS '94 Proceedings of the third international conference on on Parallel and distributed information systems
Parallel sorting on a shared-nothing architecture using probabilistic splitting
PDIS '91 Proceedings of the first international conference on Parallel and distributed information systems
Transaction Processing: Concepts and Techniques
Transaction Processing: Concepts and Techniques
A Case for NOW (Networks of Workstations)
IEEE Micro
Prototyping Bubba, A Highly Parallel Database System
IEEE Transactions on Knowledge and Data Engineering
Chained Declustering: A New Availability Strategy for Multiprocessor Database Machines
Proceedings of the Sixth International Conference on Data Engineering
How to Get Good Performance from the CM-5 Data Network
Proceedings of the 8th International Symposium on Parallel Processing
Active Storage for Large-Scale Data Mining and Multimedia
VLDB '98 Proceedings of the 24rd International Conference on Very Large Data Bases
Algebraic Optimization of Computations over Scientific Databases
VLDB '93 Proceedings of the 19th International Conference on Very Large Data Bases
Extending Heterogeneity to RAID Level 5
Proceedings of the General Track: 2002 USENIX Annual Technical Conference
The Architectural Costs of Streaming I/O: A Comparison of Workstations, Clusters, and SMPs
HPCA '98 Proceedings of the 4th International Symposium on High-Performance Computer Architecture
SPDP '95 Proceedings of the 7th IEEE Symposium on Parallel and Distributeed Processing
HOTOS '01 Proceedings of the Eighth Workshop on Hot Topics in Operating Systems
Performance Nonmonotonicities: A Case Study of the UltraSPARC Processor
Performance Nonmonotonicities: A Case Study of the UltraSPARC Processor
An Analysis of Error Behaviour in a Large Storage System
An Analysis of Error Behaviour in a Large Storage System
Active Message Applications Programming Interface
Active Message Applications Programming Interface
Multipol: A Distributed Data Structure Library
Multipol: A Distributed Data Structure Library
Active Disks
Implementation of tuple space machines
Implementation of tuple space machines
Cilk: efficient multithreaded computing
Cilk: efficient multithreaded computing
Performance availability for networks of workstations
Performance availability for networks of workstations
Scalable, distributed data structures for internet service construction
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Dynamic function placement for data-intensive cluster computing
ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
Observing the effects of multi-zone disks
ATEC '97 Proceedings of the annual conference on USENIX Annual Technical Conference
Improving Data Access for Computational Grid Applications
Cluster Computing
Dryad: distributed data-parallel programs from sequential building blocks
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Automatic optimization of parallel dataflow programs
ATC'08 USENIX 2008 Annual Technical Conference on Annual Technical Conference
Scheduling shared scans of large data files
Proceedings of the VLDB Endowment
Generating example data for dataflow programs
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
PLFS: a checkpoint filesystem for parallel applications
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
Experiences with CoralCDN: a five-year operational view
NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
Making a case for distributed file systems at Exascale
Proceedings of the third international workshop on Large-scale system and application performance
Programming micro-aerial vehicle swarms with karma
Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
OSDI'12 Proceedings of the 10th USENIX conference on Operating Systems Design and Implementation
TritonSort: A Balanced and Energy-Efficient Large-Scale Sorting System
ACM Transactions on Computer Systems (TOCS)
Limplock: understanding the impact of limpware on scale-out cloud systems
Proceedings of the 4th annual Symposium on Cloud Computing
Hi-index | 0.00 |
We present the design, implementation, and evaluation of run-time adaptation within the River dataflow programming environment. The goal of the River system is to provide adaptive mechanisms that allow database query-processing applications to cope with performance variations that are common in cluster platforms. We describe the system and its basic mechanisms, and carefully evaluate those mechanisms and their effectiveness. In our analysis, we answer four previously unanswered and important questions. Are the core run-time adaptive mechanisms effective, especially as compared to the ideal? What are the keys to making them work well? Can applications easily use these primitives? And finally, are there situations in which run-time adaptation is not sufficient? In performing our study, we utilize a three-pronged approach, comparing results from idealized models of system behavior, targeted simulations, and a prototype implementation. As well as providing insight on the positives and negatives of run-time adaptation both specifically in River and in a broader context, we also comment on the interplay of modeling, simulation, and implementation in system design.