Learned-loss boosting

  • Authors:
  • Giles Hooker;James O. Ramsay

  • Affiliations:
  • Department of Biological Statistics and Computational Biology, Cornell University, Ithaca, NY, 14850, USA;Department of Psychology, McGill University, Montreal, QC, H3A 2T5, Canada

  • Venue:
  • Computational Statistics & Data Analysis
  • Year:
  • 2012

Quantified Score

Hi-index 0.03

Visualization

Abstract

This paper considers a problem of jointly estimating a regression function and the distribution of residuals when both are specified non-parametrically. We present a joint penalized optimization criterion that combines log-spline density estimation with spline-based regression methods. We also examine the use of boosting methodology to estimate a regression function over a high dimensional covariate space. We demonstrate that our method has a robustification effect, and show its usefulness in diagnosing problems in data. We illustrate our methods with practical examples when likelihood is an appropriate evaluation criterion.