SpecCheck: automated generation of tests for interface conformance

  • Authors:
  • Chris Johnson

  • Affiliations:
  • University of Wisconsin, Eau Claire, Eau Claire, WI, USA

  • Venue:
  • Proceedings of the 17th ACM annual conference on Innovation and technology in computer science education
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Grading code in large introductory programming classes is fraught with difficulties. In particular, students deviate from the required specification---and these deviations in turn break instructors' test code, delay feedback, hurt grades, and drive instructors to create oppressive homework policies. We present a system called SpecCheck for automatically generating tests that inform students of these deviations before they submit their homework. Our system inspects a instructor's reference implementation of a homework and produces tests to validate student code for interface conformance. It aids in conditioning code for faster grading but avoids the hazards introduced by some autograders. We present the tool and an experience report of its effectiveness in a large first-semester programming course.