Does more uniformly distributed sampling generally lead to more accurate prediction in computer experiments?

  • Authors:
  • Longjun Liu;Wayne Wakeland

  • Affiliations:
  • Gunderson Inc., Portland, OR;Portland State University, Portland, OR

  • Venue:
  • WSC '05 Proceedings of the 37th conference on Winter simulation
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Sampling uniformity is one of the central issues for computer experiments or metamodeling. Is it generally true that more uniformly distributed sampling leads to more accurate prediction? A study was conducted to compare four designs for computer experiments, based on simulation tests and statistical analysis. Maximin Latin hypercube design (LHMm) nearly always generated more uniform sampling in two- and three- dimensional cases than does random sampling (Rd), Latin hypercube design (LHD), or Minimized centered L2 discrepancy Latin hypercube design (LHCL2). But often there was no significant difference among the means of the prediction errors by employing LHMm versus the other designs. Occasionally, even the opposite was seen. More uniform sampling did not generally lead to more accurate prediction unless sampling included extremely nonuniform cases, especially when the sample size was relatively small.