Automatic approximation of the marginal likelihood in non-Gaussian hierarchical models

  • Authors:
  • Hans J. Skaug;David A. Fournier

  • Affiliations:
  • Department of Mathematics, University of Bergen, Johannes Brunsgate 12, 5008 Bergen, Norway;Otter Research Ltd., P.O. Box 2040 Sidney, Canada V8L 3S3

  • Venue:
  • Computational Statistics & Data Analysis
  • Year:
  • 2006

Quantified Score

Hi-index 0.03

Visualization

Abstract

Fitting of non-Gaussian hierarchical random effects models by approximate maximum likelihood can be made automatic to the same extent that Bayesian model fitting can be automated by the program BUGS. The word ''automatic'' means that the technical details of computation are made transparent to the user. This is achieved by combining a technique from computer science known as ''automatic differentiation'' with the Laplace approximation for calculating the marginal likelihood. Automatic differentiation, which should not be confused with symbolic differentiation, is mostly unknown to statisticians, and hence basic ideas and results are reviewed. The computational performance of the approach is compared to that of existing mixed-model software on a suite of datasets selected from the mixed-model literature.