Optimal prediction for linear regression with infinitely many parameters

  • Authors:
  • Alexander Goldenshluger;Alexandre Tsybakov

  • Affiliations:
  • Department of Statistics, University of Haifa, Haifa 31905, Israel;Laboratoire de Probabilités et Modèles Aléatoires, Université Paris VI, BP 188, 4 place Jussieu, Paris 75252, Cedex 05, France

  • Venue:
  • Journal of Multivariate Analysis
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

The problem of optimal prediction in the stochastic linear regression model with infinitely many parameters is considered. We suggest a prediction method that outperforms asymptotically the ordinary least squares predictor. Moreover, if the random errors are Gaussian, the method is asymptotically minimax over ellipsoids in l2. The method is based on a regularized least squares estimator with weights of the Pinsker filter. We also consider the case of dynamic linear regression, which is important in the context of transfer function modeling.