Consistency of Pseudolikelihood Estimation of Fully Visible Boltzmann Machines

  • Authors:
  • Aapo Hyvärinen

  • Affiliations:
  • HIIT Basic Research Unit, Department of Computer Science, University of Helsinki, Finland Aapo.Hyvarinen@helsinki.fi

  • Venue:
  • Neural Computation
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

A Boltzmann machine is a classic model of neural computation, and a number of methods have been proposed for its estimation. Most methods are plagued by either very slow convergence or asymptotic bias in the resulting estimates. Here we consider estimation in the basic case of fully visible Boltzmann machines. We show that the old principle of pseudolikelihood estimation provides an estimator that is computationally very simple yet statistically consistent.