ZOO: A Desktop Experiment Management Environment
VLDB '96 Proceedings of the 22th International Conference on Very Large Data Bases
A blueprint for introducing disruptive technology into the Internet
ACM SIGCOMM Computer Communication Review
The case for repeated research in operating systems
ACM SIGOPS Operating Systems Review
Strategies for sound internet measurement
Proceedings of the 4th ACM SIGCOMM conference on Internet measurement
An integrated experimental environment for distributed systems and networks
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
Distributed computing with Triana on the Grid: Research Articles
Concurrency and Computation: Practice & Experience
The internet measurement data catalog
ACM SIGCOMM Computer Communication Review
Automating experimentation on distributed testbeds
Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
PlanetLab application management using plush
ACM SIGOPS Operating Systems Review
Taverna: lessons in creating a workflow environment for the life sciences: Research Articles
Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Scientific workflow management and the Kepler system: Research Articles
Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Xen and the art of repeated research
ATEC '04 Proceedings of the annual conference on USENIX Annual Technical Conference
Provenance-aware storage systems
ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
Integrated scientific workflow management for the Emulab network testbed
ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
The flexlab approach to realistic evaluation of networked systems
NSDI'07 Proceedings of the 4th USENIX conference on Networked systems design & implementation
SEER: a security experimentation EnviRonment for DETER
DETER Proceedings of the DETER Community Workshop on Cyber Security Experimentation and Test on DETER Community Workshop on Cyber Security Experimentation and Test 2007
Parallax: virtual disks for virtual machines
Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems 2008
Four enhancements to automateddistributed system experimentation methods
Proceedings of the 30th international conference on Software engineering
Managing the health of security experiments
CSET'08 Proceedings of the conference on Cyber security experimentation and test
Automating rendezvous and proxy selection in sensornets
IPSN '09 Proceedings of the 2009 International Conference on Information Processing in Sensor Networks
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
ETTM: a scalable fault tolerant network manager
Proceedings of the 8th USENIX conference on Networked systems design and implementation
The flexlab approach to realistic evaluation of networked systems
NSDI'07 Proceedings of the 4th USENIX conference on Networked systems design & implementation
Proceedings of the First Workshop on Building Analysis Datasets and Gathering Experience Returns for Security
Experimental challenges in cyber security: a story of provenance and lineage for malware
CSET'11 Proceedings of the 4th conference on Cyber security experimentation and test
Hi-index | 0.00 |
The networked and distributed systems research communities have an increasing need for "replayable" research, but our current experimentation resources fall short of satisfying this need. Replayable activities are those that can be re-executed, either as-is or in modified form, yielding new results that can be compared to previous ones. Replayability requires complete records of experiment processes and data, of course, but it also requires facilities that allow those processes to actually be examined, repeated, modified, and reused. We are now evolving Emulab, our popular network testbed management system, to be the basis of a new experimentation workbench in support of realistic, largescale, replayable research. We have implemented a new model of testbed-based experiments that allows people to move forward and backward through their experimentation processes. Integrated tools help researchers manage their activities (both planned and unplanned), software artifacts, data, and analyses. We present the workbench, describe its implementation, and report how it has been used by early adopters. Our initial case studies highlight both the utility of the current workbench and additional usability challenges that must be addressed.