Learnability and the Vapnik-Chervonenkis dimension
Journal of the ACM (JACM)
Advances in neural information processing systems 2
A Simple Neural Network Pruning Algorithm with Application to Filter Synthesis
Neural Processing Letters
Second Order Derivatives for Network Pruning: Optimal Brain Surgeon
Advances in Neural Information Processing Systems 5, [NIPS Conference]
An application of pruning in the design of neural networks for real time flood forecasting
Neural Computing and Applications
Estimation of Dependences Based on Empirical Data: Springer Series in Statistics (Springer Series in Statistics)
| Hi-index | 0.00 |
In any real world application, the performance of Artificial Neural Networks (ANN) is mostly depends upon its generalization capability. Generalization of the ANN is ability to handle unseen data. The generalization capability of the network is mostly determined by system complexity and training of the network. Poor generalization is observed when the network is over-trained or system complexity (or degree of freedom) is relatively more than the training data. A smaller network which can fit the data will have the k good generalization ability. Network parameter pruning is one of the promising methods to reduce the degree of freedom of a network and hence improve its generalization. In recent years various pruning methods have been developed and found effective in real world applications. Next, it is important to estimate the improvement in generalization and rate of improvement as pruning being incorporated in the network. A method is developed in this research to evaluate generalization capability and rate of convergence towards the generalization. Using the proposed method, experiments have been conducted to evaluate Multi-Layer Perceptron neural network with pruning being incorporated for handwritten numeral recognition.