Eliciting properties of probability distributions

  • Authors:
  • Nicolas S. Lambert;David M. Pennock;Yoav Shoham

  • Affiliations:
  • Stanford University, Stanford, CA, USA;Yahoo! Research, New York, NY, USA;Stanford University, Stanford, CA, USA

  • Venue:
  • Proceedings of the 9th ACM conference on Electronic commerce
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

We investigate the problem of truthfully eliciting an expert's assessment of a property of a probability distribution, where a property is any real-valued function of the distribution such as mean or variance. We show that not all properties are elicitable; for example, the mean is elicitable and the variance is not. For those that are elicitable, we provide a representation theorem characterizing all payment (or "score") functions that induce truthful revelation. We also consider the elicitation of sets of properties. We then observe that properties can always be inferred from sets of elicitable properties. This naturally suggests the concept of elicitation complexity; the elicitation complexity of property is the minimal size of such a set implying the property. Finally we discuss applications to prediction markets.