An investigation into keystroke latency metrics as an indicator of programming performance

  • Authors:
  • Richard C. Thomas;Amela Karahasanovic;Gregor E. Kennedy

  • Affiliations:
  • The University of Western Australia, Western Australia;Simula Research Laboratory, Lysaker, Norway;The University of Melbourne, Parkville, Vic, Australia

  • Venue:
  • ACE '05 Proceedings of the 7th Australasian conference on Computing education - Volume 42
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Typing has long been studied in psychology and HCI, and strong cognitive models for transcription typing exist. The goal of the present research was to test if there is any correlation between students' keystroking speed and performance while they are programming. We present the results from two studies with computer science students conducted in different contexts. Keystroke timings were recorded while they worked on Java and Ada source code. Quality of their programming work was measured mainly in terms of completeness. In the controlled experiment that lasted six hours, 39 students undertook three change tasks on a 6000 LOC Java application. In the field study, data was collected over 6 weeks from 141 students while they worked unsupervised on Ada programming in first year laboratories. In both cases there were highly significant (P=0.001), moderately strong, negative correlations between speed and coding performance. With additional development, these techniques may have promise for user modelling and assessment as well as in educational diagnostics.