Diversity-Based Feature Selection from Neural Network with Low Computational Cost

  • Authors:
  • Md. Monirul Kabir;Md. Shahjahan;Kazuyuki Murase

  • Affiliations:
  • Department of Human and Artificial Intelligence Systems, Graduate School of Engineering,;Department of Electrical and Electronic Engineering, Khulna University of Engineering and Technology, Khulna, Bangladesh 9203;Department of Human and Artificial Intelligence Systems, Graduate School of Engineering, and Research and Education Program for Life Science, University of Fukui, Fukui, Japan 910-8507

  • Venue:
  • Neural Information Processing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a new approach to identify the activity of input attributes efficiently in the wrapper model of feature selection. The relevant features are selected by the diversity among the inputs of the neural network and the entire process is done depending on several criteria. While the most of existing feature selection methods use all input attributes by examining network performance, we use here only the attributes having relatively high possibilities to contribute to the network performance knowing preceding assumptions. The proposed diversity-based feature selection method (DFSM) can therefore significantly reduce the size of hidden layer priori to feature selection process without degrading the network performance. We tested DFSM to several real world benchmark problems and the experimental results confirmed that it could select a small number of relevant features with good classification accuracies.