Computer adaptive testing: comparison of a probabilistic network approach with item response theory

  • Authors:
  • Michel C. Desmarais;Xiaoming Pu

  • Affiliations:
  • École Polytechnique de Montréal, Montréal, QC, Canada;École Polytechnique de Montréal, Montréal, QC, Canada

  • Venue:
  • UM'05 Proceedings of the 10th international conference on User Modeling
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Bayesian and probabilistic networks are claimed to offer powerful approaches to inferring an individual's knowledge state from evidence of mastery of concepts or skills. A typical application where such tools can be useful is Computer Adaptive Testing (CAT). Bayesian networks have been proposed as an alternative to the traditional Item Response Theory (IRT), which has been the prevalent CAT approach for the last three decades. We compare the performance of one probabilistic network approach, named POKS, to the IRT two parameter logistic model. Experimental results over a 34 items UNIX test and a 160 items French language test show that both approaches can classify examinees as master or non master effectively and efficiently. Implications of these results for adaptive testing and student modeling are discussed.