Some theoretical properties of mutual information for student assessments in intelligent tutoring systems

  • Authors:
  • Chao-Lin Liu

  • Affiliations:
  • Dept. of Computer Science, Nat'l Chengchi Univ., Taipei, Taiwan

  • Venue:
  • ISMIS'05 Proceedings of the 15th international conference on Foundations of Intelligent Systems
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents recently discovered properties of mutual information between concepts and dichotomous test items. The properties generalize some common intuitions for comparing test items, and provide principled foundations for designing item-selection heuristics for student assessments in computer-assisted educational systems. We compare performance profiles achieved by systems that adopt mutual information and the Mahalanobis distance in the assessment task. Experimental results reveal that, all else being equal, the mutual information based methods offer better performance profiles. In addition, experimental results suggest that, when computing mutual information online is considered computationally costly, heuristics that are designed based on our theoretical findings serve as a good delegate for exact mutual information.