A multi-expert approach for developing testing and diagnostic systems based on the concept-effect model

  • Authors:

  • Patcharin Panjaburee;Gwo-Jen Hwang;Wannapong Triampo;Bo-Ying Shih

  • Affiliations:

  • Institute for Innovative Learning, Mahidol University, 999, Phuttamonthon 4 Road, Salaya, Nakorn Pathom 73170, Thailand;Department of Information and Learning Technology, National University of Tainan 33, Sec. 2, Shulin St., Tainan city 70005, ROC, Taiwan;Department of Physics, Faculty of Science, Mahidol University, Rama VI, Bangkok 10400, Thailand;Department of Information and Learning Technology, National University of Tainan 33, Sec. 2, Shulin St., Tainan city 70005, ROC, Taiwan

  • Venue:
  • Computers & Education
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

With the popularization of computer and communication technologies, researchers have attempted to develop computer-assisted testing and diagnostic systems to help students improve their learning performance on the Internet. In developing a diagnostic system for detecting students' learning problems, it is difficult for individual teachers to address the exact relationships between the test items and the concepts. To cope with this problem, this study proposes an innovative approach to eliciting and integrating the weightings of test item-concept relationships from multiple experts. Based on the proposed approach, a testing and diagnostic system has been implemented; moreover, an experiment was conducted to evaluate the performance of our approach. By analyzing the results from four groups of students using learning suggestions provided by different models, it was found that the learning performance of the students who received learning suggestions by applying the innovative approach was significantly better than for those who received guidance based on the original model.