Karel the robot (2nd ed.): a gentle introduction to the art of programming
Karel the robot (2nd ed.): a gentle introduction to the art of programming
Grading student programs using ASSYST
SIGCSE '97 Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education
Alice: a 3-D tool for introductory programming concepts
CCSC '00 Proceedings of the fifth annual CCSC northeastern conference on The journal of computing in small colleges
The CourseMarker CBA System: Improvements over Ceilidh
Education and Information Technologies
Working group reports from ITiCSE on Innovation and technology in computer science education
CS educational research: a meta-analysis of SIGCSE technical symposium proceedings
Proceedings of the 35th SIGCSE technical symposium on Computer science education
Visualizing programs with Jeliot 3
Proceedings of the working conference on Advanced visual interfaces
Constructing a core literature for computing education research
ACM SIGCSE Bulletin
EasyAccept: a tool to easily create, run and drive development with automated acceptance tests
Proceedings of the 2006 international workshop on Automation of software test
Combating anonymousness in populous CS1 and CS2 courses
Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education
Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education
An introspective approach to marking graphical user interfaces
Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education
EduComponents: experiences in e-assessment in computer science education
Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education
Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education
RoboCode & problem-based learning: a non-prescriptive approach to teaching programming
Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education
On the suitability of programming tasks for automated evaluation
Informatics in education
Drivers for software refactoring decisions
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
The boss online submission and assessment system
Journal on Educational Resources in Computing (JERIC)
Automatic test-based assessment of programming: A review
Journal on Educational Resources in Computing (JERIC)
Individualized exercises for self-assessment of programming knowledge: An evaluation of QuizPACK
Journal on Educational Resources in Computing (JERIC)
Journal on Educational Resources in Computing (JERIC)
Stingray: a hands-on approach to learning information security
Proceedings of the 7th conference on Information technology education
Experiences using test-driven development with an automated grader
Journal of Computing Sciences in Colleges
Objects First With Java: A Practical Introduction Using BlueJ (3rd Edition)
Objects First With Java: A Practical Introduction Using BlueJ (3rd Edition)
Semantic similarity-based grading of student programs
Information and Software Technology
Journal of Systems and Software
Checking automatically the output of concurrent threads
Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education
Interface-based programming assignments and automatic grading of java programs
Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education
Computer assisted assessment of diagrams
Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education
VERKKOKE: learning routing and network programming online
Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education
Providing accurate and timely feedback by automatically grading student programming labs
Journal of Computing Sciences in Colleges
Proceedings of the 5th international symposium on Principles and practice of programming in Java
Proceedings of the 6th Baltic Sea conference on Computing education research: Koli Calling 2006
Creating and visualizing test data from programming exercises
Informatics in education
WBED'07 Proceedings of the sixth conference on IASTED International Conference Web-Based Education - Volume 2
An experimental study of the impact of visual semantic feedback on novice programming
Journal of Visual Languages and Computing
APOGEE: automated project grading and instant feedback system for web based computing
Proceedings of the 39th SIGCSE technical symposium on Computer science education
Supporting student-written tests of gui programs
Proceedings of the 39th SIGCSE technical symposium on Computer science education
Teaching software development with ATDD and easyaccept
Proceedings of the 39th SIGCSE technical symposium on Computer science education
Proceedings of the 13th annual conference on Innovation and technology in computer science education
Towards generic and flexible web services for e-assessment
Proceedings of the 13th annual conference on Innovation and technology in computer science education
Digital CS1 study pack based on Moodle and Python
Proceedings of the 13th annual conference on Innovation and technology in computer science education
Web-CAT: automatically grading programming assignments
Proceedings of the 13th annual conference on Innovation and technology in computer science education
WebTasks: online programming exercises made easy
Proceedings of the 13th annual conference on Innovation and technology in computer science education
Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology
A web-based programming learning environment to support cognitive development
Interacting with Computers
An Assessment Tool for Assembly Language Programming
CSSE '08 Proceedings of the 2008 International Conference on Computer Science and Software Engineering - Volume 05
A Visualization-Based Computer Science Hypertextbook Prototype
ACM Transactions on Computing Education (TOCE) - Special Issue on the 5th Program Visualization Workshop (PVW’08)
Learning from and with peers: the different roles of student peer reviewing
ITiCSE '09 Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education
A course on algorithms and data structures using on-line judging
ITiCSE '09 Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education
Engaging students in specification and reasoning: "hands-on" experimentation and evaluation
ITiCSE '09 Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education
Affective and behavioral predictors of novice programmer achievement
ITiCSE '09 Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education
"Mailing it in": email-centric automated assessment
ITiCSE '09 Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education
Analysis of research into the teaching and learning of programming
ICER '09 Proceedings of the fifth international workshop on Computing education research workshop
The automated web application testing (AWAT) system
Proceedings of the 46th Annual Southeast Regional Conference on XX
Marking student programs using graph similarity
Computers & Education
A new Moodle module supporting automatic verification of VHDL-based assignments
Computers & Education
Automatic Grading System on SQL Programming
SCALCOM-EMBEDDEDCOM '09 Proceedings of the 2009 International Conference on Scalable Computing and Communications; Eighth International Conference on Embedded Computing
Electronic commerce virtual laboratory
Proceedings of the 41st ACM technical symposium on Computer science education
Proceedings of the 16th annual conference reports on Innovation and technology in computer science education - working group reports
JUG: a JUnit generation, time complexity analysis and reporting tool to streamline grading
Proceedings of the 17th ACM annual conference on Innovation and technology in computer science education
Multi-faceted support for MOOC in programming
Proceedings of the 13th annual conference on Information technology education
A mobile learning application for parsons problems with automatic feedback
Proceedings of the 12th Koli Calling International Conference on Computing Education Research
Proceedings of the 12th Koli Calling International Conference on Computing Education Research
FLOP, a free laboratory of programming
Proceedings of the 12th Koli Calling International Conference on Computing Education Research
Impact of auto-grading on an introductory computing course
Journal of Computing Sciences in Colleges
Scaffolding students' learning using test my code
Proceedings of the 18th ACM conference on Innovation and technology in computer science education
Software verification and graph similarity for automated evaluation of students' assignments
Information and Software Technology
Proceedings of the 45th ACM technical symposium on Computer science education
Using CodeBrowser to seek differences between novice programmers
Proceedings of the 45th ACM technical symposium on Computer science education
Automated Assessment of Programming Assignments
Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education Research
Student perception and usage of an automated programming assessment tool
Computers in Human Behavior
International Journal of Technology Enhanced Learning
Hi-index | 0.00 |
This paper presents a systematic literature review of the recent (2006--2010) development of automatic assessment tools for programming exercises. We discuss the major features that the tools support and the different approaches they are using both from the pedagogical and the technical point of view. Examples of these features are ways for the teacher to define tests, resubmission policies, security issues, and so forth. We have also identified a list of novel features, like assessing web software, that are likely to get more research attention in the future. As a conclusion, we state that too many new systems are developed, but also acknowledge the current reasons for the phenomenon. As one solution we encourage opening up the existing systems and joining efforts on developing those further. Selected systems from our survey are briefly described in Appendix A.