Complementary Log-Log and Probit: Activation Functions Implemented in Artificial Neural Networks

Authors:
Gecynalda S. da S. Gomes;Teresa B. Ludermir
Affiliations:
-;-
Venue:
HIS '08 Proceedings of the 2008 8th International Conference on Hybrid Intelligent Systems
Year:
2008

Citing 0
Cited 2

Neural networks with asymmetric activation function for function approximation

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Optimization of the weights and asymmetric activation function family of neural network for time series forecasting

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

The types of activation functions most often used in artificial neural networks are logistic and hyperbolic tangent. Activation functions used in ANN have been said to play an important role in the convergence of the algorithms used. This paper uses sigmoid functions in the processing units of neural networks. Such functions are commonly applied in statistical regression models. The nonlinear functions implemented here are the inverse of complementary log-log and probit link functions. A Monte Carlo framework is presented to evaluate the results of prediction power with these nonlinear functions.