Linear mixed models and penalized least squares

  • Authors:
  • Douglas M. Bates;Saikat DebRoy

  • Affiliations:
  • Department of Statistics, University of Wisconsin-Madison, 1210 West Dayton St., Madison;Department of Biostatistics, Harvard School of Public Health

  • Venue:
  • Journal of Multivariate Analysis - Special issue on semiparametric and nonparametric mixed models
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Linear mixed-effects models are an important class of statistical models that are used directly in many fields of applications and also are used as iterative steps in fitting other types of mixed-effects models, such as generalized linear mixed models. The parameters in these models are typically estimated by maximum likelihood or restricted maximum likelihood. In general, there is no closed-form solution for these estimates and they must be determined by iterative algorithms such as EM iterations or general nonlinear optimization. Many of the intermediate calculations for such iterations have been expressed as generalized least squares problems. We show that an alternative representation as a penalized least squares problem has many advantageous computational properties including the ability to evaluate explicitly a profiled log-likelihood or log-restricted likelihood, the gradient and Hessian of this profiled objective, and an ECME update to refine this objective.