Parallel Coarse Grain Computing of Boltzmann Machines

  • Authors:
  • Julio Ortega;Ignacio Rojas;Antonio F. Diaz;Alberto Prieto

  • Affiliations:
  • Departamento de Arquitectura Tecnología de Computadores, Universidad de Granada;Departamento de Arquitectura Tecnología de Computadores, Universidad de Granada;Departamento de Arquitectura Tecnología de Computadores, Universidad de Granada;Departamento de Arquitectura Tecnología de Computadores, Universidad de Granada

  • Venue:
  • Neural Processing Letters
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

The resolution of combinatorial optimization problemscan greatly benefit from the parallel and distributedprocessing which is characteristic of neural networkparadigms. Nevertheless, the fine grain parallelism ofthe usual neural models cannot be implemented in anentirely efficient way either in general-purposemulticomputers or in networks of computers, which arenowadays the most common parallel computerarchitectures. Therefore, we present a parallelimplementation of a modified Boltzmann machine wherethe neurons are distributed among the processors ofthe multicomputer, which asynchronously compute theevolution of their subset of neurons using values forthe other neurons that might not be updated, thusreducing the communication requirements. Severalalternatives to allow the processors to workcooperatively are analyzed and their performancedetailed. Among the proposed schemes, we haveidentified one that allows the corresponding BoltzmannMachine to converge to solutions with high quality andwhich provides a high acceleration over the executionof the Boltzmann machine in uniprocessor computers.