Automated Scoring for Creative Problem Solving Ability with Ideation-Explanation Modeling

  • Authors:

  • Hao-Chuan Wang;Chun-Yen Chang;Tsai-Yen Li

  • Affiliations:

  • Institute of Information Science, Academia Sinica, Taiwan, haochuan@iis.sinica.edu.tw;Department of Earth Sciences, National Taiwan Normal University, Taiwan, changcy@cc.ntnu.edu.tw;Department of Computer Science, National Chengchi University, Taiwan, li@nccu.edu.tw

  • Venue:
  • Proceedings of the 2005 conference on Towards Sustainable and Scalable Educational Innovations Informed by the Learning Sciences: Sharing Good Practices of Research, Experimentation and Innovation
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes an automated scorer for assessing students' Creative Problem-Solving (CPS) abilities via modeling the intra-structure of students' essays describing their thoughts on solving particular problems. The automated scorer aims to grade students' open-ended responses to an essay-question-type CPS ability test, instead of using typical Likert-type or multiple-choice questions that may be imperfect to assess the creative perspective of human problem-solving. The scorer is distinguishable to most generic automated essay scoring systems that a bipartite graph-based representation is explicitly built for the pair-wise relation between a student's ideas and self-explained reasons for a CPS task. This design will enable several analytical approaches for CPS, such as quantitative scoring and qualitative diagnoses. The preliminary empirical evaluation with 20 students' data shows that the scoring results of the scorer is satisfactory and highly correlated with those of human experts (Pearson's r=.67∼.82) in terms of quantitative scoring task. The approach provides a promising solution to support large-scaled studies on human creativity and may further enable CPS-aware personalization systems.