Correlation of grade prediction performance and validity of self-evaluation comments

  • Authors:
  • Kazumasa Goda;Sachio Hirokawa;Tsunenori Mine

  • Affiliations:
  • Kyushu Institute of Information Science, Dazaifu, Japan;Kyushu University, Fukuoka, Japan;Kyushu University, Fukuoka, Japan

  • Venue:
  • Proceedings of the 14th annual ACM SIGITE conference on Information technology education
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

To grasp a student's lesson attitude and learning situation and to give a feed back to each student are educational foundations. Goda et al. proposed the PCN method to estimate a learning situation from a comment freely written by students[6, 7]. The PCN method categorizes comments into three items of P (previous), C(current) and N(next). They pointed out a correlation between the student's final results and the validity of a descriptive content of item C, that is something related to understanding of the lesson and learning attitudes to the lesson. However, a problem left in their work is the badness of performance in prediction for upper grade students. This paper proposes two manners of utilization of PCN scores: the validity level determination for assessment, and for prediction performance of students' final grades. In order to validate the proposed manners of utilization, we conducted two experiments. First, we employed multiple regression analysis to calculate PCN scores that determine the validity level with respect to each viewpoint. Students who wrote comments with a high PCN score are considered as those who describe their learning attitude appropriately. We also applied a machine learning method SVM (support vector machine) to students' comments for predicting their final results in five grades of S, A, B, C and D. Experimental results illustrated that as comments of students get higher PCN scores, the prediction performance of the students' grades becomes higher.