Workflow-based assessment of student online activities with topic and dialogue role classification

  • Authors:
  • Jun Ma;Jeon-Hyung Kang;Erin Shaw;Jihie Kim

  • Affiliations:
  • Information Science Institute, University of Southern California, Marina del Rey, CA;Information Science Institute, University of Southern California, Marina del Rey, CA;Information Science Institute, University of Southern California, Marina del Rey, CA;Information Science Institute, University of Southern California, Marina del Rey, CA

  • Venue:
  • AIED'11 Proceedings of the 15th international conference on Artificial intelligence in education
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Pedagogical Assessment Workflow System (PAWS) is a new workflow-based pedagogical assessment framework that enables the efficient and robust integration of diverse datasets for the purposes of student assessment. The paper highlights two particular e-learning workflows supported by PAWS. The first workflow correlates student performance, as measured by project grades, with different dialogue roles, information seeker and information provider, that students take on in project-based discussion forums. The second workflow identifies the distribution of question topics within student discussions. Both workflows employ state of the art natural language processing techniques and machine learning algorithms for dialogue classification tasks. Workflow results were reviewed with a course instructor and feedback regarding the analysis and its fidelity are reported.