Developing a generalizable detector of when students game the system

  • Authors:

  • Ryan S. Baker;Albert T. Corbett;Ido Roll;Kenneth R. Koedinger

  • Affiliations:

  • Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, USA 15213;Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, USA 15213;Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, USA 15213;Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, USA 15213

  • Venue:
  • User Modeling and User-Adapted Interaction
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Some students, when working in interactive learning environments, attempt to "game the system", attempting to succeed in the environment by exploiting properties of the system rather than by learning the material and trying to use that knowledge to answer correctly. In this paper, we present a system that can accurately detect whether a student is gaming the system, within a Cognitive Tutor mathematics curricula. Our detector also distinguishes between two distinct types of gaming which are associated with different learning outcomes. We explore this detector's generalizability, and find that it transfers successfully to both new students and new tutor lessons.