Feature salience for neural networks: comparing algorithms

  • Authors:
  • Theodor Heinze;Martin von Löwis;Andreas Polze

  • Affiliations:
  • Hasso-Plattner-Institute for Software Systems Engineering, Germany;Hasso-Plattner-Institute for Software Systems Engineering, Germany;Hasso-Plattner-Institute for Software Systems Engineering, Germany

  • Venue:
  • ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part IV
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

One of the key problems in the field of telemedicine is the prediction of the patient's health state change based on incoming non-invasively measured vital data. Artificial Neural Networks (ANN) are a powerful statistical modeling tool suitable for this problem. Feature salience algorithms for ANN provide information about feature importance and help selecting relevant input variables. Looking for a reliable salience analysis algorithm, we found a relatively wide range of possible approaches. However, we have also found numerous methodological weaknesses in corresponding evaluations. Perturb [11][7] and Connection Weight (CW) [1] are two of the most promising algorithms. In this paper, we propose an improvement for Connection Weight and evaluate it along with Perturb and the original CW. We use three independent datasets with already known feature salience rankings as well as varying topologies and random feature ranking results to estimate the usability of the tested approaches for feature salience assessment in complex multi-layer perceptrons.