Automatic summary assessment for intelligent tutoring systems

  • Authors:
  • Yulan He;Siu Cheung Hui;Tho Thanh Quan

  • Affiliations:
  • Knowledge Media Institute, The Open University, Milton Keynes MK7 6AA, UK;School of Computer Engineering, Nanyang Technological University, Nanyang Avenue, Singapore 639798, Singapore;Faculty of Computer Science and Engineering, Hochiminh City University of Technology, Hochiminh City, Viet Nam

  • Venue:
  • Computers & Education
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

Summary writing is an important part of many English Language Examinations. As grading students' summary writings is a very time-consuming task, computer-assisted assessment will help teachers carry out the grading more effectively. Several techniques such as latent semantic analysis (LSA), n-gram co-occurrence and BLEU have been proposed to support automatic evaluation of summaries. However, their performance is not satisfactory for assessing summary writings. To improve the performance, this paper proposes an ensemble approach that integrates LSA and n-gram co-occurrence. As a result, the proposed ensemble approach is able to achieve high accuracy and improve the performance quite substantially compared with current techniques. A summary assessment system based on the proposed approach has also been developed.