Evaluation and Comparison of Inferred Regular Grammars

  • Authors:
  • Neil Walkinshaw;Kirill Bogdanov;Ken Johnson

  • Affiliations:
  • The Department of Computer Science, The University of Sheffield, Sheffield, U.K. S1 4DP;The Department of Computer Science, The University of Sheffield, Sheffield, U.K. S1 4DP;The Department of Computer Science, The University of Sheffield, Sheffield, U.K. S1 4DP

  • Venue:
  • ICGI '08 Proceedings of the 9th international colloquium on Grammatical Inference: Algorithms and Applications
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

The accuracy of an inferred grammar is commonly computed by measuring the percentage of sequences that are correctly classified from a random sample of sequences produced by the target grammar. This approach is problematic because (a) it is unlikely that a random sample of sequences will adequately test the grammar and (b) the use of a single probability value provides little insight into the extent to which a grammar is (in-)accurate. This paper addresses these two problems by proposing the use of established model-based testing techniques from the field of software engineering to systematically generate test sets, along with the use of the Precision and Recall measure from the field of information retrieval to concisely represent the accuracy of the inferred machine.