Computer simulation in management science
Computer simulation in management science
Transient exponential-Erlang queues and steady-state simulation
Communications of the ACM
The P2 algorithm for dynamic calculation of quantiles and histograms without storing observations
Communications of the ACM
Decomposition of some well-known variance reduction techniques
Journal of Statistical Computation and Simulation
Distributed discrete-event simulation
ACM Computing Surveys (CSUR)
Numerical recipes: the art of scientific computing
Numerical recipes: the art of scientific computing
Fundamentals of queueing theory (2nd ed.).
Fundamentals of queueing theory (2nd ed.).
System simulation programming styles and languages
System simulation programming styles and languages
A guide to simulation (2nd ed.)
A guide to simulation (2nd ed.)
Time series: theory and methods
Time series: theory and methods
Statistical tools for simulation practitioners
Statistical tools for simulation practitioners
Regeneration and networks of queues
Regeneration and networks of queues
Simulating GI/G/k Queues in heavy traffic
Management Science
Catalog of simulation software
Simulation
Epistemology of knowlege based simulation
Simulation
Transient behavior of the M/M/1 queue: starting at the origin
Queueing Systems: Theory and Applications
Parallel processing simulation of large computer networks
1987 Symposium on the simulation of computer networks on Simulation of computer networks
Parallel discrete-event simulation of FCFS stochastic queueing networks
PPEALS '88 Proceedings of the ACM/SIGPLAN conference on Parallel programming: experience with applications, languages and systems
Random number generators: good ones are hard to find
Communications of the ACM
Operations Research
Parallel simulation of queueing networks: limitations and potentials
SIGMETRICS '89 Proceedings of the 1989 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Overview of standardized time series
WSC '85 Proceedings of the 17th conference on Winter simulation
Large-sample theory for standardized time series: an overview
WSC '85 Proceedings of the 17th conference on Winter simulation
A comparison between standardized time series and overlapping batched means
WSC '85 Proceedings of the 17th conference on Winter simulation
The correlation between mean and variance estimators
WSC '85 Proceedings of the 17th conference on Winter simulation
Using path control variates in activity network simulation
WSC '85 Proceedings of the 17th conference on Winter simulation
An introduction to the Research Queueing Package
WSC '85 Proceedings of the 17th conference on Winter simulation
WSC '85 Proceedings of the 17th conference on Winter simulation
Performance evaluation of hierarchical distributed simulators
WSC '85 Proceedings of the 17th conference on Winter simulation
Two approaches to the implementation of a distributed simulation system
WSC '85 Proceedings of the 17th conference on Winter simulation
Some steady-state problems in simulation
ANSS '85 Proceedings of the 18th annual symposium on Simulation
A relaxation time approach for reducing initialization bias in simulation
ANSS '85 Proceedings of the 18th annual symposium on Simulation
WSC '88 Proceedings of the 20th conference on Winter simulation
High performance parallelized discrete event simulation of stochastic queueing networks
WSC '88 Proceedings of the 20th conference on Winter simulation
A spectrum of options for parallel simulation
WSC '88 Proceedings of the 20th conference on Winter simulation
Minimal-MSE linear combinations of variance estimators of the sample mean
WSC '88 Proceedings of the 20th conference on Winter simulation
Confidence intervals and orthonormally weighted standardized time series
WSC '88 Proceedings of the 20th conference on Winter simulation
A comparison of confidence region estimators for multivariate simulation output
WSC '88 Proceedings of the 20th conference on Winter simulation
Multivariate estimation and variance reduction in terminating and steady-state simulation
WSC '88 Proceedings of the 20th conference on Winter simulation
Covariance of regenerative mean and variance estimators for Markov chains
WSC '88 Proceedings of the 20th conference on Winter simulation
Variance reduction in mean time to failure simulations
WSC '88 Proceedings of the 20th conference on Winter simulation
An algorithm for testing serial dependence of simulation output data
WSC '88 Proceedings of the 20th conference on Winter simulation
Initializing for bias reduction: some analytical considerations
WSC '88 Proceedings of the 20th conference on Winter simulation
Statistical design and analysis
WSC '86 Proceedings of the 18th conference on Winter simulation
WSC '86 Proceedings of the 18th conference on Winter simulation
The Smalltalk simulation environment
WSC '86 Proceedings of the 18th conference on Winter simulation
The use of graphical models in model validation
WSC '86 Proceedings of the 18th conference on Winter simulation
Using simulation to solve problems: a tutorial on the analysis of simulation output
WSC '87 Proceedings of the 19th conference on Winter simulation
Multivariate inference in stationary simulation using batch means
WSC '87 Proceedings of the 19th conference on Winter simulation
On strong consistency of the variance estimator
WSC '87 Proceedings of the 19th conference on Winter simulation
Correlation among estimators of the variance of the sample mean
WSC '87 Proceedings of the 19th conference on Winter simulation
On the relationship between batch means, overlapping means and spectral estimation
WSC '87 Proceedings of the 19th conference on Winter simulation
Large and small sample comparisons of various variance estimators
WSC '86 Proceedings of the 18th conference on Winter simulation
Statistical analysis of parallel simulations
WSC '86 Proceedings of the 18th conference on Winter simulation
Sensitivity analysis via likelihood ratios
WSC '86 Proceedings of the 18th conference on Winter simulation
A Bonferroni selection procedure when using commom random numbers with unknown variances
WSC '86 Proceedings of the 18th conference on Winter simulation
Tutorial on indifference-zone normal means ranking and selection procedures
WSC '86 Proceedings of the 18th conference on Winter simulation
An interactive run length control for simulation on PCs
WSC '86 Proceedings of the 18th conference on Winter simulation
Automated estimation and variance reduction for steady-state simulations
WSC '86 Proceedings of the 18th conference on Winter simulation
Estimation procedures based on control variates with known covariance matrix
WSC '87 Proceedings of the 19th conference on Winter simulation
Simulating Stable Stochastic Systems, I: General Multiserver Queues
Journal of the ACM (JACM)
Simulating Stable Stochastic Systems, VI: Quantile Estimation
Journal of the ACM (JACM)
A conceptual framework for research in the analysis of simulation output
Communications of the ACM - Special issue on simulation modeling and statistical computing
A spectral method for confidence interval generation and run length control in simulations
Communications of the ACM - Special issue on simulation modeling and statistical computing
Control of initialization bias in multivariate simulation response
Communications of the ACM - Special issue on simulation modeling and statistical computing
Minimum mean-squared-error estimators for simulation experiments
Communications of the ACM - Special issue on simulation modeling and statistical computing
Regression-adjusted estimates for regenerative simulations, with graphics
Communications of the ACM - Special issue on simulation modeling and statistical computing
Achieving specific accuracy in simulation output analysis
Communications of the ACM
Time series: data analysis and theory
Time series: data analysis and theory
Simulation Using GPSS
Probability and Statistics with Reliability, Queuing and Computer Science Applications
Probability and Statistics with Reliability, Queuing and Computer Science Applications
Discrete System Simulation
Simulation Techniques for Discrete Event Systems
Simulation Techniques for Discrete Event Systems
Principles of Discrete Event Simulation
Principles of Discrete Event Simulation
System Simulation
Introduction to Simulation: Programming Techniques and Methods Analysis
Introduction to Simulation: Programming Techniques and Methods Analysis
Numerical Methods for Scientists and Engineers
Numerical Methods for Scientists and Engineers
Simulation Modeling and Analysis
Simulation Modeling and Analysis
Time Series Analysis, Forecasting and Control
Time Series Analysis, Forecasting and Control
An Introduction to the Regenerative Method for Simulation Analysis
An Introduction to the Regenerative Method for Simulation Analysis
The Transient Behaviour of Networks with Infinite Server Nodes
Performance '84 Proceedings of the Tenth International Symposium on Computer Performance Modelling, Measurement and Evaluation
Ranking and selection in simulation
WSC '83 Proceedings of the 15th conference on Winter Simulation - Volume 2
Multivariate estimation in simulation
WSC '83 Proceedings of the 15th conference on Winter Simulation - Volume 2
Further investigation into spectral analysis for confidence intervals in steady state simulations
WSC '81 Proceedings of the 13th conference on Winter simulation - Volume 2
Tests for the verification and validation of computer simulation models
WSC '81 Proceedings of the 13th conference on Winter simulation - Volume 2
Interactive analysis of simulation output by the method of batch means
WSC '79 Proceedings of the 11th conference on Winter simulation - Volume 2
The initial transient in steady state simulation (Panel Discussion)
WSC '81 Proceedings of the 13th conference on Winter simulation - Volume 1
Overlapping batch means: something for nothing?
WSC '84 Proceedings of the 16th conference on Winter simulation
Multivariate simulation output analysis: Past, present, and future
WSC '84 Proceedings of the 16th conference on Winter simulation
Interactive analysis of output from GPSS-based simulations
WSC '78 Proceedings of the 10th conference on Winter simulation - Volume 1
Coverage error for confidence intervals arising in simulation output analysis
WSC '82 Proceedings of the 14th conference on Winter Simulation - Volume 2
A regression technique for determining steady state conditions in time series simulations
WSC '82 Proceedings of the 14th conference on Winter Simulation - Volume 2
The art of simulation
Analyzing algorithms by simulation: variance reduction techniques and simulation speedups
ACM Computing Surveys (CSUR)
Memory contention for shared memory vector multiprocessors
Proceedings of the 1992 ACM/IEEE conference on Supercomputing
The TickerTAIP parallel RAID architecture
ISCA '93 Proceedings of the 20th annual international symposium on computer architecture
Run length control using parallel spectral method
WSC '92 Proceedings of the 24th conference on Winter simulation
A sequential procedure for simultaneous estimation of several means
ACM Transactions on Modeling and Computer Simulation (TOMACS)
The TickerTAIP parallel RAID architecture
ACM Transactions on Computer Systems (TOCS)
Distributed stochastic discrete-event simulation in parallel time streams
WSC '94 Proceedings of the 26th conference on Winter simulation
Estimating steady state mean from short transient simulations
WSC '96 Proceedings of the 28th conference on Winter simulation
Experimental evaluation of confidence interval procedures in sequential steady-state simulation
WSC '96 Proceedings of the 28th conference on Winter simulation
The impact of transients on simulation variance estimators
Proceedings of the 29th conference on Winter simulation
Determining a warm-up period for a telephone network routing simulation
Proceedings of the 31st conference on Winter simulation: Simulation---a bridge to the future - Volume 1
Automating parallel simulation using parallel time streams
ACM Transactions on Modeling and Computer Simulation (TOMACS)
A perspective of batching methods in a simulation environment of multiple replications in parallel
Proceedings of the 32nd conference on Winter simulation
Proceedings of the 32nd conference on Winter simulation
Experimental Analysis of Timing Validation Methods for Distributed Real-Time Systems
The Journal of Supercomputing
Metrics for Parallel Job Scheduling and Their Convergence
JSSPP '01 Revised Papers from the 7th International Workshop on Job Scheduling Strategies for Parallel Processing
QoS-IP 2003 Proceedings of the Second International Workshop on Quality of Service in Multiservice IP Networks
Quality-of-Service for Video and Data in Very-High-Speed DQDB MANs
MASCOTS '95 Proceedings of the 3rd International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems
MASCOTS '96 Proceedings of the 4th International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems
Modeling the time varying behavior of mobile ad-hoc networks
MSWiM '04 Proceedings of the 7th ACM international symposium on Modeling, analysis and simulation of wireless and mobile systems
Proceedings of the 34th conference on Winter simulation: exploring new frontiers
Simulation output analysis: truncation point estimation using multiple replications in parallel
Proceedings of the 35th conference on Winter simulation: driving innovation
Initial transient problem for steady-state output analysis
WSC '05 Proceedings of the 37th conference on Winter simulation
Automated analysis of simulation output data
WSC '05 Proceedings of the 37th conference on Winter simulation
On an initial transient deletion rule with rigorous theoretical support
Proceedings of the 38th conference on Winter simulation
Exploiting regenerative structure to estimate finite time averages via simulation
ACM Transactions on Modeling and Computer Simulation (TOMACS)
Using parallel replications for sequential estimation of multiple steady state quantiles
Proceedings of the 2nd international conference on Performance evaluation methodologies and tools
Proceedings of the 2nd international conference on Performance evaluation methodologies and tools
Caspian: A Tunable Performance Model for Multi-core Systems
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
On the feasibility of dynamic congestion-based pricing in differentiated services networks
IEEE/ACM Transactions on Networking (TON)
Comparative analysis of routing protocols for VoIP in a Wireless Mesh Backbone: a user perspective
International Journal of Internet Protocol Technology
Automating warm-up length estimation
Proceedings of the 40th Conference on Winter Simulation
Proceedings of the 40th Conference on Winter Simulation
JMT: performance engineering tools for system modeling
ACM SIGMETRICS Performance Evaluation Review
QPME: a performance modeling tool based on queueing Petri Nets
ACM SIGMETRICS Performance Evaluation Review
User-friendly approach to capacity planning studies with Java modelling tools
Proceedings of the 2nd International Conference on Simulation Tools and Techniques
On the automation of computer network simulators
Proceedings of the 2nd International Conference on Simulation Tools and Techniques
When, and when not to use warm-up periods in discrete event simulation
Proceedings of the 2nd International Conference on Simulation Tools and Techniques
A comprehensive power-performance model for NoCs with multi-flit channel buffers
Proceedings of the 23rd international conference on Supercomputing
Performance modeling of n-dimensional mesh networks
Performance Evaluation
Power-performance analysis of networks-on-chip with arbitrary buffer allocation schemes
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems - Special section on the ACM IEEE international conference on formal methods and models for codesign (MEMOCODE) 2009
A conflict-free traffic assignment algorithm using forward planning
INFOCOM'96 Proceedings of the Fifteenth annual joint conference of the IEEE computer and communications societies conference on The conference on computer communications - Volume 3
A framework for designing congestion-aware deterministic routing
Proceedings of the Third International Workshop on Network on Chip Architectures
QPME 2.0: a tool for stochastic modeling and analysis using queueing Petri nets
From active data management to event-based systems and more
Pitfalls in parallel job scheduling evaluation
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
Tools for performance evaluation of computer systems: historical evolution and perspectives
PERFORM'10 Proceedings of the 2010 IFIP WG 6.3/7.3 international conference on Performance Evaluation of Computer and Communication Systems: milestones and future challenges
Introduction to queueing petri nets: modeling formalism, tool support and case studies
ICPE '12 Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering
Research: Fairness and efficiency of slot reuse algorithms in DQDB MANS
Computer Communications
Stochastic modeling and analysis using QPME: queueing petri net modeling environment v2.0
PETRI NETS'12 Proceedings of the 33rd international conference on Application and Theory of Petri Nets
Safe: simulation automation framework for experiments
Proceedings of the Winter Simulation Conference
Rethinking the initialization bias problem in steady-state discrete event simulation
Proceedings of the Winter Simulation Conference
Proceedings of the Winter Simulation Conference
Reinsch's smoothing spline simulation metamodels
Proceedings of the Winter Simulation Conference
Efficient genetic based topological mapping using analytical models for on-chip networks
Journal of Computer and System Sciences
Workload resampling for performance evaluation of parallel job schedulers
Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering
An analytical latency model for networks-on-chip
IEEE Transactions on Very Large Scale Integration (VLSI) Systems
| Hi-index | 0.00 |
For years computer-based stochastic simulation has been a commonly used tool in the performance evaluation of various systems. Unfortunately, the results of simulation studies quite often have little credibility, since they are presented without regard to their random nature and the need for proper statistical analysis of simulation output data.This paper discusses the main factors that can affect the accuracy of stochastic simulations designed to give insight into the steady-state behavior of queuing processes. The problems of correctly starting and stopping such simulation experiments to obtain the required statistical accuracy of the results are addressed. In this survey of possible solutions, the emphasis is put on possible applications in the sequential analysis of output data, which adaptively decides about continuing a simulation experiment until the required accuracy of results is reached. A suitable solution for deciding upon the starting point of a steady-state analysis and two techniques for obtaining the final simulation results to a required level of accuracy are presented, together with pseudocode implementations.