Leveraging a domain ontology to increase the quality of feedback in an intelligent tutoring system

  • Authors:
  • Hameedullah Kazi;Peter Haddawy;Siriwan Suebnukarn

  • Affiliations:
  • ,Computer Science & Information Management Program, Asian Institute of Technology, Thailand;Computer Science & Information Management Program, Asian Institute of Technology, Thailand;School of Dentistry, Thammasat University, Thailand

  • Venue:
  • ITS'10 Proceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part I
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Tutoring systems typically contain or generate a set of approved solutions to problems presented to students. Student solutions that don't match the approved ones, but are otherwise partially correct, receive little acknowledgment as feedback, stifling broader reasoning. Additionally, feedback mechanisms rely on having the student model, which requires extensive effort to build. This paper provides an alternative to the traditional ITS architecture by using a hint generation strategy that bypasses the student model and instead leverages off of the domain ontology. Concept hierarchy and co-occurrence between concepts in the domain ontology are drawn upon to ascertain partial correctness of a solution and guide student reasoning towards the correct solution. We describe the strategy incorporated in a tutoring system for medical PBL, wherein the widely available UMLS is deployed as the domain ontology. Evaluation of expert agreement with system generated hints on a 5-point likert scale resulted in an average score of 4.44 (r = 0.9018, p