Introductory programming: examining the exams

Authors:
Simon;Donald Chinn;Michael de Raadt;Anne Philpott;Judy Sheard;Mikko-Jussi Laakso;Daryl D'Souza;James Skene;Angela Carbone;Tony Clear;Raymond Lister;Geoff Warburton
Affiliations:
University of Newcastle;University of Washington, Tacoma;Moodle;Auckland University of Technology;Monash University;University of Turku;RMIT University;Auckland University of Technology;Monash University;Auckland University of Technology;University of Technology Sydney;Australia
Venue:
ACE '12 Proceedings of the Fourteenth Australasian Computing Education Conference - Volume 123
Year:
2012

Citing 19
Cited 3

Content and emphasis in CS1

ACM SIGCSE Bulletin
Most difficult topics in CS1: results of an online survey of educators

ACM SIGCSE Bulletin
What do teachers teach in introductory programming?

Proceedings of the second international workshop on Computing education research
Parson's programming puzzles: a fun and effective learning tool for first programming courses

ACE '06 Proceedings of the 8th Australasian Conference on Computing Education - Volume 52
An Australasian study of reading and comprehension skills in novice programmers, using the bloom and SOLO taxonomies

ACE '06 Proceedings of the 8th Australasian Conference on Computing Education - Volume 52
After the gold rush: toward sustainable scholarship in computing

ACE '08 Proceedings of the tenth conference on Australasian computing education - Volume 78
Going SOLO to assess novice programmers

Proceedings of the 13th annual conference on Innovation and technology in computer science education
Relationships between reading, tracing and writing skills in introductory programming

ICER '08 Proceedings of the Fourth international Workshop on Computing Education Research
Classifying computing education papers: process and results

ICER '08 Proceedings of the Fourth international Workshop on Computing Education Research
Analysis of research into the teaching and learning of programming

ICER '09 Proceedings of the fifth international workshop on Computing education research workshop
A closer look at tracing, explaining and code writing skills in the novice programmer

ICER '09 Proceedings of the fifth international workshop on Computing education research workshop
Naturally occurring data as research instrument: analyzing examination responses to study the novice programmer

ACM SIGCSE Bulletin
Developing a validated assessment of fundamental CS1 concepts

Proceedings of the 41st ACM technical symposium on Computer science education
Making sense of data structures exams

Proceedings of the Sixth international workshop on Computing education research
Applying data structures in exams

Proceedings of the 42nd ACM technical symposium on Computer science education
Reviewing CS1 exam question content

Proceedings of the 42nd ACM technical symposium on Computer science education
Exploring programming assessment instruments: a classification scheme for examination questions

Proceedings of the seventh international workshop on Computing education research
Assessing fundamental introductory computing concept knowledge in a language independent manner

Assessing fundamental introductory computing concept knowledge in a language independent manner
Concrete and other neo-Piagetian forms of reasoning in the novice programmer

ACE '11 Proceedings of the Thirteenth Australasian Computing Education Conference - Volume 114

Assessment of programming: pedagogical foundations of exams

Proceedings of the 18th ACM conference on Innovation and technology in computer science education
Toward a shared understanding of competency in programming: an invitation to the BABELnot project

ACE '12 Proceedings of the Fourteenth Australasian Computing Education Conference - Volume 123
The Canterbury QuestionBank: building a repository of multiple-choice CS1 and CS2 questions

Proceedings of the ITiCSE working group reports conference on Innovation and technology in computer science education-working group reports

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a classification scheme that can be used to investigate the characteristics of introductory programming examinations. The scheme itself is described and its categories explained. We describe in detail the process of determining the level of agreement among classifiers, that is, the inter-rater reliability of the scheme, and we report the results of applying the classification scheme to 20 introductory programming examinations. We find that introductory programming examinations vary greatly in the coverage of topics, question styles, skill required to answer questions and the level of difficulty of questions. This study is part of a project that aims to investigate the nature and composition of formal examination instruments used in the summative assessment of introductory programming students, and the pedagogical intentions of the educators who construct these instruments.