Classification errors in a domain-independent assessment system

  • Authors:
  • Rodney D. Nielsen;Wayne Ward;James H. Martin

  • Affiliations:
  • University of Colorado, Boulder and Boulder Language Technologies, Boulder, CO;University of Colorado, Boulder and Boulder Language Technologies, Boulder, CO;University of Colorado, Boulder

  • Venue:
  • EANL '08 Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a domain-independent technique for assessing learners' constructed responses. The system exceeds the accuracy of the majority class baseline by 15.4% and a lexical baseline by 5.9%. The emphasis of this paper is to provide an error analysis of performance, describing the types of errors committed, their frequency, and some issues in their resolution.