Neurocomputing
Introduction to the theory of neural computation
Introduction to the theory of neural computation
The cascade-correlation learning architecture
Advances in neural information processing systems 2
Variations of the two-spiral task
Connection Science
| Hi-index | 0.00 |
This paper presents a novel approach under regular backpropagation. We introduce hybrid neural nets that have different activation functions for different layers in fully connected feed forward neural nets. We change the parameters of activation functions in hidden layers and output layer to accelerate the learning speed and to reduce the oscillation respectively. Results on the two-spirals benchmark are presented which are better than any results under backpropagation feed forward nets using monotone activation functions published previously.