The impact of machine learning on expert systems
CSC '93 Proceedings of the 1993 ACM conference on Computer science
The nature of statistical learning theory
The nature of statistical learning theory
One-time complete indexing of text: theory and practice
SIGIR '85 Proceedings of the 8th annual international ACM SIGIR conference on Research and development in information retrieval
Fast training of support vector machines using sequential minimal optimization
Advances in kernel methods
An introduction to support Vector Machines: and other kernel-based learning methods
An introduction to support Vector Machines: and other kernel-based learning methods
A vector space model for automatic indexing
Communications of the ACM
Machine learning in automated text categorization
ACM Computing Surveys (CSUR)
Introduction to Modern Information Retrieval
Introduction to Modern Information Retrieval
A Tutorial on Support Vector Machines for Pattern Recognition
Data Mining and Knowledge Discovery
The Debate on Automated Essay Grading
IEEE Intelligent Systems
Text Categorization with Suport Vector Machines: Learning with Many Relevant Features
ECML '98 Proceedings of the 10th European Conference on Machine Learning
An introduction to variable and feature selection
The Journal of Machine Learning Research
SIGHAN '03 Proceedings of the second SIGHAN workshop on Chinese language processing - Volume 17
Supporting CSCL with automatic corpus analysis technology
CSCL '05 Proceedings of th 2005 conference on Computer support for collaborative learning: learning 2005: the next 10 years!
Assessing tenth-grade students' problem solving ability online in the area of Earth sciences
Computers in Human Behavior
Thinking hard together: the long and short of collaborative idea generation in scientific inquiry
CSCL'07 Proceedings of the 8th iternational conference on Computer supported collaborative learning
A study of cross-validation and bootstrap for accuracy estimation and model selection
IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
VIBRANT: a brainstorming agent for computer supported creative problem solving
ITS'06 Proceedings of the 8th international conference on Intelligent Tutoring Systems
AutoTutor: an intelligent tutoring system with mixed-initiative dialogue
IEEE Transactions on Education
Automatic grading of scientific inquiry
Proceedings of the Seventh Workshop on Building Educational Applications Using NLP
| Hi-index | 0.00 |
The work aims to improve the assessment of creative problem-solving in science education by employing language technologies and computational-statistical machine learning methods to grade students' natural language responses automatically. To evaluate constructs like creative problem-solving with validity, open-ended questions that elicit students' constructed responses are beneficial. But the high cost required in manually grading constructed responses could become an obstacle in applying open-ended questions. In this study, automated grading schemes have been developed and evaluated in the context of secondary Earth science education. Empirical evaluations revealed that the automated grading schemes may reliably identify domain concepts embedded in students' natural language responses with satisfactory inter-coder agreement against human coding in two sub-tasks of the test (Cohen's Kappa=.65-.72). And when a single holistic score was computed for each student, machine-generated scores achieved high inter-rater reliability against human grading (Pearson's r=.92). The reliable performance in automatic concept identification and numeric grading demonstrates the potential of using automated grading to support the use of open-ended questions in science assessments and enable new technologies for science learning.