Information Collection on a Graph

  • Authors:
  • Ilya O. Ryzhov;Warren B. Powell

  • Affiliations:
  • Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08540;Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08540

  • Venue:
  • Operations Research
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We derive a knowledge gradient policy for an optimal learning problem on a graph, in which we use sequential measurements to refine Bayesian estimates of individual edge values in order to learn about the best path. This problem differs from traditional ranking and selection in that the implementation decision (the path we choose) is distinct from the measurement decision (the edge we measure). Our decision rule is easy to compute and performs competitively against other learning policies, including a Monte Carlo adaptation of the knowledge gradient policy for ranking and selection.