Accurate unlexicalized parsing
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Predicting reading difficulty with statistical language models
Journal of the American Society for Information Science and Technology
The linguist's search engine: an overview
ACLdemo '05 Proceedings of the ACL 2005 on Interactive poster and demonstration sessions
Applications of lexical information for algorithmically composing multiple-choice cloze items
EdAppsNLP 05 Proceedings of the second workshop on Building Educational Applications Using NLP
A real-time multiple-choice question generation for language testing: a preliminary study
EdAppsNLP 05 Proceedings of the second workshop on Building Educational Applications Using NLP
An analysis of statistical models and features for reading difficulty prediction
EANL '08 Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications
READ-IT: assessing readability of Italian texts with a view to text simplification
SLPAT '11 Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies
Automatic generation of cloze question stems
PROPOR'12 Proceedings of the 10th international conference on Computational Processing of the Portuguese Language
| Hi-index | 0.00 |
Computer generation of cloze tasks still falls short of full automation; most current systems are used by teachers as authoring aids. Improved methods to estimate cloze quality are needed for full automation. We investigated lexical reading difficulty as a novel automatic estimator of cloze quality, to which co-occurrence frequency of words was compared as an alternate estimator. Rather than relying on expert evaluation of cloze quality, we submitted open cloze tasks to workers on Amazon Mechanical Turk (AMT) and discuss ways to measure of the results of these tasks. Results show one statistically significant correlation between the above measures and estimators, which was lexical co-occurrence and Cloze Easiness. Reading difficulty was not found to correlate significantly. We gave subsets of cloze sentences to an English teacher as a gold standard. Sentences selected by co-occurrence and Cloze Easiness were ranked most highly, corroborating the evidence from AMT.