Probability, statistics, and queueing theory with computer science applications
Probability, statistics, and queueing theory with computer science applications
Dealing with complexity: exploratory analysis enabled by multiresolultion, multiperspective modeling
Proceedings of the 32nd conference on Winter simulation
Visualization of test information to assist fault localization
Proceedings of the 24th International Conference on Software Engineering
Bug isolation via remote program sampling
PLDI '03 Proceedings of the ACM SIGPLAN 2003 conference on Programming language design and implementation
Locating causes of program failures
Proceedings of the 27th international conference on Software engineering
Scalable statistical bug isolation
Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation
Empirical evaluation of the tarantula automatic fault-localization technique
Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
New paradigms and new challenges
WSC '05 Proceedings of the 37th conference on Winter simulation
Discrete-Event Simulation: A First Course
Discrete-Event Simulation: A First Course
Explanation Exploration: Exploring Emergent Behavior
Proceedings of the 21st International Workshop on Principles of Advanced and Distributed Simulation
On the Accuracy of Spectrum-based Fault Localization
TAICPART-MUTATION '07 Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION
Cooperative debugging with five hundred million test cases
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
Fault localization using value replacement
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
Introduction to Information Retrieval
Introduction to Information Retrieval
Validating Evolving Simulations in COERCE
ICCS '07 Proceedings of the 7th international conference on Computational Science, Part I: ICCS 2007
Applying causal inference to understand emergent behavior
Proceedings of the 40th Conference on Winter Simulation
Statistical debugging with elastic predicates
ASE '11 Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering
Modifying test suite composition to enable effective predicate-level statistical debugging
NFM'12 Proceedings of the 4th international conference on NASA Formal Methods
Applying enhanced fault localization technology to Monte Carlo simulations
Proceedings of the Winter Simulation Conference
Hi-index | 0.00 |
Predictions from simulations with inherent uncertainty have entered the mainstream of public policy decision-making practices. Unfortunately, methods for gaining insight into unexpected simulation outcomes have not kept pace. Subject matter experts (SMEs) need to understand if the unexpected outcomes reflect a fault in the simulation or new knowledge. Recent work has adapted statistical debuggers, used in software engineering, to automatically identify simulation faults via extensive profiling of executions. The adapted debuggers have been shown to be effective, but have only been applied to simulations with large test suites and known faults. Here we employ these debuggers in a different manner. We investigate how they facilitate a SME exploring an unexpected outcome that reflects new knowledge. We also evaluate the debuggers in the face of smaller test suites and sparse execution profiling. These novel applications and evaluations show that these debuggers are more effective and robust than previously realized.