An approximate analytical approach to resampling averages

  • Authors:
  • Dörthe Malzahn;Manfred Opper

  • Affiliations:
  • Informatics and Mathematical Modelling, Technical University of Denmark, R.-Petersens-Plads, Building 321, Lyngby, DK-2800, Denmark and Institute of Mathematical Stochastics, University of Karlsru ...;School of Engineering and Applied Science, Aston University, Birmingham, B4 7ET, United Kingdom

  • Venue:
  • The Journal of Machine Learning Research
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Using a novel reformulation, we develop a framework to compute approximate resampling data averages analytically. The method avoids multiple retraining of statistical models on the samples. Our approach uses a combination of the replica "trick" of statistical physics and the TAP approach for approximate Bayesian inference. We demonstrate our approach on regression with Gaussian processes. A comparison with averages obtained by Monte-Carlo sampling shows that our method achieves good accuracy.