Improving procedures for evaluation of connectionist context-free language predictors

Authors:
H. Jacobsson;T. Ziemke
Affiliations:
Dept. of Comput. Sci., Univ. of Skovde, Sweden;-
Venue:
IEEE Transactions on Neural Networks
Year:
2003

Citing 0
Cited 3

Rule Extraction from Recurrent Neural Networks: A Taxonomy and Review

Neural Computation
The Crystallizing Substochastic Sequential Machine Extractor: CrySSMEx

Neural Computation
CrySSMEx, a novel rule extractor for recurrent neural networks: overview and case study

ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

This letter shows how seemingly minor differences in training and evaluation procedures used in recent studies of recurrent neural networks as context free language predictors can lead to significant differences in apparent network performance. We suggest standard evaluation procedures whose use would facilitate better reproductibility and comparability.