Using simulated students for the assessment of authentic document retrieval

Authors:
Jonathan Brown;Maxine Eskenazi
Affiliations:
Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PA;Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PA
Venue:
ITS'06 Proceedings of the 8th international conference on Intelligent Tutoring Systems
Year:
2006

Citing 2
Cited 0

Applications of simulated students: an exploration

Journal of Artificial Intelligence in Education
Automatic question generation for vocabulary assessment

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In the REAP system, users are automatically provided with texts to read that are targeted to their individual reading abilities and needs. To assess such a system, students with different abilities use it, and then researchers measure how well it addresses their needs. In this paper, we describe an approach using simulated students to perform this assessment. This enables researchers to determine if the system functions well enough for the students to learn the curriculum and how factors such as corpus size and retrieval criteria affect performance. We discuss how we have used simulated students to assess the REAP system and to prepare for an upcoming study, as well as future work.