Exploring programming assessment instruments: a classification scheme for examination questions

Authors:
Judy Sheard; Simon;Angela Carbone;Donald Chinn;Mikko-Jussi Laakso;Tony Clear;Michael de Raadt;Daryl D'Souza;James Harland;Raymond Lister;Anne Philpott;Geoff Warburton
Affiliations:
Monash University, Melbourne, Australia;University of Newcastle, Newcastle, Australia;Monash University, Melbourne, Australia;University of Washington, Tacoma, USA;University of Turku, Turku, Finland;Auckland University of Technology, Auckland, New Zealand;University of Southern Queensland, Toowoomba, Australia;RMIT University, Melbourne, Australia;RMIT University, Melbourne, Australia;University of Technology, Sydney, Sydney, Australia;Auckland University of Technology, Auckland, New Zealand;RMIT University, Melbourne, Australia
Venue:
Proceedings of the seventh international workshop on Computing education research
Year:
2011

Citing 16
Cited 7

Content and emphasis in CS1

ACM SIGCSE Bulletin
Most difficult topics in CS1: results of an online survey of educators

ACM SIGCSE Bulletin
What do teachers teach in introductory programming?

Proceedings of the second international workshop on Computing education research
Parson's programming puzzles: a fun and effective learning tool for first programming courses

ACE '06 Proceedings of the 8th Australasian Conference on Computing Education - Volume 52
An Australasian study of reading and comprehension skills in novice programmers, using the bloom and SOLO taxonomies

ACE '06 Proceedings of the 8th Australasian Conference on Computing Education - Volume 52
Going SOLO to assess novice programmers

Proceedings of the 13th annual conference on Innovation and technology in computer science education
Relationships between reading, tracing and writing skills in introductory programming

ICER '08 Proceedings of the Fourth international Workshop on Computing Education Research
Classifying computing education papers: process and results

ICER '08 Proceedings of the Fourth international Workshop on Computing Education Research
A closer look at tracing, explaining and code writing skills in the novice programmer

ICER '09 Proceedings of the fifth international workshop on Computing education research workshop
Naturally occurring data as research instrument: analyzing examination responses to study the novice programmer

ACM SIGCSE Bulletin
Developing a validated assessment of fundamental CS1 concepts

Proceedings of the 41st ACM technical symposium on Computer science education
Making sense of data structures exams

Proceedings of the Sixth international workshop on Computing education research
Applying data structures in exams

Proceedings of the 42nd ACM technical symposium on Computer science education
Reviewing CS1 exam question content

Proceedings of the 42nd ACM technical symposium on Computer science education
Assessing fundamental introductory computing concept knowledge in a language independent manner

Assessing fundamental introductory computing concept knowledge in a language independent manner
Concrete and other neo-Piagetian forms of reasoning in the novice programmer

ACE '11 Proceedings of the Thirteenth Australasian Computing Education Conference - Volume 114

Stepping up to integrative questions on CS1 exams

Proceedings of the 43rd ACM technical symposium on Computer Science Education
Classifying problems to explain patterns of correlation on the 1988 advanced placement computer science exam

Journal of Computing Sciences in Colleges
Can computing academics assess the difficulty of programming examination questions?

Proceedings of the 12th Koli Calling International Conference on Computing Education Research
Toward a shared understanding of competency in programming: an invitation to the BABELnot project

ACE '12 Proceedings of the Fourteenth Australasian Computing Education Conference - Volume 123
Introductory programming: examining the exams

ACE '12 Proceedings of the Fourteenth Australasian Computing Education Conference - Volume 123
Student created cheat-sheets in examinations: impact on student outcomes

ACE '12 Proceedings of the Fourteenth Australasian Computing Education Conference - Volume 123
Identifying challenging CS1 concepts in a large problem dataset

Proceedings of the 45th ACM technical symposium on Computer science education

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes the development of a classification scheme that can be used to investigate the characteristics of introductory programming examinations. We describe the process of developing the scheme, explain its categories, and present a taste of the results of a pilot analysis of a set of CS1 exam papers. This study is part of a project that aims to investigate the nature and composition of formal examination instruments used in the summative assessment of introductory programming students, and the pedagogical intentions of the educators who construct these instruments.