Generalizing detection of gaming the system across a tutoring curriculum

  • Authors:

  • Ryan S. J. d. Baker;Albert T. Corbett;Kenneth R. Koedinger;Ido Roll

  • Affiliations:

  • Learning Sciences Research Institute, University of Nottingham, Nottingham, UK;Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA;Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA;Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA

  • Venue:
  • ITS'06 Proceedings of the 8th international conference on Intelligent Tutoring Systems
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In recent years, a number of systems have been developed to detect differences in how students choose to use intelligent tutoring systems, and the attitudes and goals which underlie these decisions. These systems, when trained using data from human observations and questionnaires, can detect specific behaviors and attitudes with high accuracy. However, such data is time-consuming to collect, especially across an entire tutor curriculum. Therefore, to deploy a detector of behaviors or attitudes across an entire tutor curriculum, the detector must be able to transfer to a new tutor lesson without being re-trained using data from that lesson. In this paper, we present evidence that detectors of gaming the system can transfer to new lessons without re-training, and that training detectors with data from multiple lessons improves generalization, beyond just the gains from training with additional data.