An Analytic Method for Evaluating the Performance of Aggregation Rules for Probability Densities

Authors:
Stephen C. Hora
Affiliations:
Viterbi School of Engineering, and School of Policy, Planning, and Development, University of Southern California, Los Angeles, California 90089
Venue:
Operations Research
Year:
2010

Citing 3
Cited 0

Correlations and Copulas for Decision and Risk Analysis

Management Science
Numerical Recipes in FORTRAN: The Art of Scientific Computing

Numerical Recipes in FORTRAN: The Art of Scientific Computing
Probability Judgments for Continuous Quantities: Linear Combinations and Calibration

Management Science

Quantified Score

Hi-index	0.00

Visualization

Abstract

It is shown how infinite sequences of densities with defined properties can be used to evaluate the expected performance of mathematical aggregation rules for elicited densities. The performance of these rules is measured through the average variance, calibration, and average Brier score of the aggregates. A general result for the calibration of the arithmetic average of densities from well-calibrated independent experts is given. Arithmetic and geometric aggregation rules are compared using sequences of normal densities. Sequences are developed that exhibit dependence among experts and lack of calibration. The impact of correlation, number of experts, and degree of calibration on the performance of the aggregation is demonstrated.