Could Enough Samples be more Important than Better Designs for Computer Experiments?

  • Authors:
  • Longjun Liu

  • Affiliations:
  • Portland State University

  • Venue:
  • ANSS '05 Proceedings of the 38th annual Symposium on Simulation
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

A study was conducted to compare fifteen approaches to improve Latin hypercube designs for computer experiments, based on simulation tests and statistical analyses ANOVA. Kriging models were employed to approximate twenty test functions. Validation at 5000 or 10,000 points was conducted to find prediction errors. The results show that there are statistically significant differences between the approximatin results of employing different designs, but more often the difference is not significant. In most cases, the number of runs or the sample size has stronger impact on the accuracy than do different designs. When the dimension is low, a small size increment can often reduce more error than do "better designs." To get the desired precision by one-stage method, enough samples may be needed regardless what design is used. Sample size determination may need much more attention for computer experiments.