Problems with Evaluation of Unsupervised Empirical Grammatical Inference Systems

  • Authors:
  • Menno Zaanen;Jeroen Geertzen

  • Affiliations:
  • Dept. of Communication & Information Sciences, Tilburg University, Tilburg, The Netherlands;Dept. of Communication & Information Sciences, Tilburg University, Tilburg, The Netherlands

  • Venue:
  • ICGI '08 Proceedings of the 9th international colloquium on Grammatical Inference: Algorithms and Applications
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Empirical grammatical inference systems are practical systems that learn structure from sequences, in contrast to theoretical grammatical inference systems, which prove learnability of certain classes of grammars. All current empirical grammatical inference evaluation methods are problematic, i.e. dependency on language experts, appropriateness and quality of an underlying grammar of the data, and influence of the parameters of the evaluation metrics. Here, we propose a modification of an evaluation method to reduce the ambiguity of results.