Predictions of bridge scour: Application of a feed-forward neural network with an adaptive activation function

Authors:
A. Ismail;D. -S. Jeng;L. L. Zhang;J. -S. Zhang
Affiliations:
Center for Marine Geotechnical Engineering Research, Department of Civil Engineering, Shanghai Jiao Tong University, Shanghai 200240, China and Division of Civil Engineering, University of Dundee, ...;Center for Marine Geotechnical Engineering Research, Department of Civil Engineering, Shanghai Jiao Tong University, Shanghai 200240, China and Division of Civil Engineering, University of Dundee, ...;Center for Marine Geotechnical Engineering Research, Department of Civil Engineering, Shanghai Jiao Tong University, Shanghai 200240, China;State Key Laboratory of Hydrology-Water Resources and Hydraulic Engineering, Hohai University, 210098, China
Venue:
Engineering Applications of Artificial Intelligence
Year:
2013

Citing 8
Cited 0

Multilayer feedforward networks are universal approximators

Neural Networks
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations

Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations
Learning and approximation capabilities of adaptive spline activation function neutral networks

Neural Networks
Justification of a Neuron-Adaptive Activation Function

IJCNN '00 Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 3 - Volume 3
Neural network and neuro-fuzzy assessments for scour depth around bridge piers

Engineering Applications of Artificial Intelligence
Generalized Regression Neural Networks and Feed Forward Neural Networks for prediction of scour depth around bridge piers

Advances in Engineering Software
Multilayer feedforward networks with adaptive spline activation function

IEEE Transactions on Neural Networks
Training feedforward networks with the Marquardt algorithm

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this study, a new procedure to determine the optimum activation function for a neural network is proposed. Unlike previous methods of optimising activation functions, the proposed approach regards selection of the most suitable activation function as a discrete optimisation problem, which involves generating various combinations of function then evaluating their performance as activation functions in a neural network, returning the function or combination of functions which yields best result as the optimum. The efficacy of the proposed optimisation method is compared with conventional approaches using the data generated from several synthetic functions. Numerical results indicate that the network produced using the proposed method achieves a better accuracy with a smaller network size, compared to other approaches. Bridge scour problem is used to further demonstrate the performance of the proposed algorithm. Based on the training and validation results, a better estimation of both equilibrium and time dependent scour depth is produced by the neural network developed using the proposed optimisation method, compared to networks with a priori chosen activation functions. Furthermore, the performance of the proposed model is compared with predictions of empirical methods, with the former making more accurate predictions.