Feature Subset Selection Using Constructive Neural Nets with Minimal Computation by Measuring Contribution

  • Authors:
  • Md. Monirul Kabir;Md. Shahjahan;Kazuyuki Murase

  • Affiliations:
  • Department of Human and Artificial Intelligence Systems, Graduate School of Engineering,;Department of Electrical and Electronic Engineering, Khulna University of Engineering and Technology, Khulna, Bangladesh 9203;Department of Human and Artificial Intelligence Systems, Graduate School of Engineering, and Research and Education Program for Life Science, University of Fukui, Japan 910-8507

  • Venue:
  • Neural Information Processing
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we propose a new approach to select feature subset based on contribution of input attributes in a three-layered feedforward neural network (NN). Three techniques: constructive, contribution, and backward elimination are integrated together in this method. Initially, to determine the minimal NN architecture, the number of hidden neurons is determined by a constructive approach. After that, one-by-one removal of input attributes is performed to compute their contribution. Finally, a sequential backward elimination is used to generate relevant feature subset from the original input space. The elimination process is continued depending on a criterion. To evaluate the proposed method, we applied it to four real-world benchmark problems. Experimental results confirmed that, the proposed method significantly reduces the irrelevant features without degrading the network performance and generates the feature subset with good generalization ability.