A fast, streaming simd extensions 2, logistic squashing function

  • Authors:
  • J. J. Milner;A. J. Grandison

  • Affiliations:
  • School of Computing and Mathematical Sciences, University of Greenwich, Greenwich, London SE10 9SL, U.K. cplusplus@hotmail.co.uk;School of Computing and Mathematical Sciences, University of Greenwich, Greenwich, London SE10 9SL, U.K. A.J.Grandison@gre.ac.uk

  • Venue:
  • Neural Computation
  • Year:
  • 2008

Quantified Score

Hi-index 0.01

Visualization

Abstract

Schraudolph proposed an excellent exponential approximation providing increased performance particularly suited to the logistic squashing function used within many neural networking applications. This note applies Intel's streaming SIMD Extensions 2 (SSE2), where SIMD is single instruction multiple data, of the Pentium IV class processor to Schraudolph's technique, further increasing the performance of the logistic squashing function. It was found that the calculation of the new 32-bit SSE2 logistic squashing function described here was up to 38 times faster than the conventional exponential function and up to 16 times faster than a Schraudolph-style 32-bit method on an Intel Pentium D 3.6 GHz CPU.