Parameter determination and feature selection for back-propagation network by particle swarm optimization

  • Authors:
  • Shih-Wei Lin;Shih-Chieh Chen;Wen-Jie Wu;Chih-Hsien Chen

  • Affiliations:
  • Chang Gung University, Department of Information Management, 259 Wen-Hwa 1st Road, Kwei-Shan, 333, Tao-Yuan, Taiwan, ROC;National Taiwan University of Science and Technology, Department of Industrial Engineering, No. 43, Sec. 4, Keelung Rd., 106, Taipei, Taiwan, ROC;Chang Gung University, Department of Information Management, 259 Wen-Hwa 1st Road, Kwei-Shan, 333, Tao-Yuan, Taiwan, ROC;Fo-Guang University, Department of Management, No.160, Linwei Rd., Jiaosi Shiang, 26247, Yilan, Taiwan, ROC

  • Venue:
  • Knowledge and Information Systems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

The back-propagation network (BPN) is a popular tool with applications in a variety of fields. Nevertheless, different problems may require different parameter settings for a given network architecture. A dataset may contain many features, but not all features are beneficial for classification by the BPN. Therefore, a particle-swarm-optimization-based approach, denoted as PSOBPN, is proposed to obtain the suitable parameter settings for BPN and to select the beneficial subset of features which result in a better classification accuracy rate. A set of 23 problems with a range of examples and features drawn from the UCI (University of California, Irvine) machine learning repository is adopted to test the performance of the proposed algorithm. The results are compared with several well-known published algorithms. The comparative study shows that the proposed approach improves the classification accuracy rate in most test problems. Furthermore, when the feature selection is taken into consideration, the classification accuracy rates of most datasets are increased. The proposed algorithm should thus be useful to both practitioners and researchers.