A method of automatic grade calibration in peer assessment

Authors:
John Hamer;Kenneth T. K. Ma;Hugh H. F. Kwong
Affiliations:
University of Auckland, Auckland, New Zealand;University of Auckland, Auckland, New Zealand;University of Auckland, Auckland, New Zealand
Venue:
ACE '05 Proceedings of the 7th Australasian conference on Computing education - Volume 42
Year:
2005

Citing 3
Cited 4

Electronic peer review and peer grading in computer-science courses

Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education
Grading essays in computer ethics: rubrics considered helpful

SIGCSE '02 Proceedings of the 33rd SIGCSE technical symposium on Computer science education
Effective peer assessment for learning computer programming

Proceedings of the 9th annual SIGCSE conference on Innovation and technology in computer science education

Peer assessment using aropä

ACE '07 Proceedings of the ninth Australasian conference on Computing education - Volume 66
Two peers are better than one: aggregating peer reviews for computing assignments is surprisingly accurate

Proceedings of the ACM 2009 international conference on Supporting group work
Learning from and with peers: the different roles of student peer reviewing

ITiCSE '09 Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education
Quality of peer assessment in CS1

ICER '09 Proceedings of the fifth international workshop on Computing education research workshop

Quantified Score

Hi-index	0.00

Visualization

Abstract

Once the exclusive preserve of small graduate courses, peer assessment is being rediscovered as an effective and efficient learning tool in large undergraduate classes, a transition made possible through the use of electronic assignment submissions and web-based support software.Asking large numbers of undergraduates to grade each others work raises a number of obvious concerns. How will mark reliability and validity be maintained? Can plagiarism be detected or prevented? What effect will "rogue" reviewers have on the integrity of the process? Will effective learning actually occur?In this paper we address the issue of grade reliability, and present a novel technique for identifying and minimising the impact of "rogues." Simulations suggest the method is effective under a wide range of conditions.