A Controlled Experiment to Evaluate On-Line Process Guidance

  • Authors:

  • Christopher M. Lott

  • Affiliations:

  • Bell Communications Research, 445 South Street, MCC 1H-331B, Morristown, NJ 07960, USA/ c.m.lott@ieee.org

  • Venue:
  • Empirical Software Engineering
  • Year:
  • 1997

Quantified Score

Hi-index 0.00

Visualization

Abstract

Process-centered software engineering environments areexpected to improve an individual‘s comprehension of work activities,as well as improve communication and reduce conflicts among teamsof software developers. We chose to investigate individual responseswhen using such an environment before looking for a group response.A controlled experiment compared off-line and on-line implementationsof measurement-based process guidance to test three hypotheses:first, individuals accomplish their work more efficiently whenusing on-line process guidance as compared to off-line guidance;second, individuals are willing to use an on-line system forguidance; and third, individuals adjust their behavior basedon quantitative quality models. The subjectsworked alone on two testing exercises. Subjects used either anoff-line or an on-line guidance technique during the first exercise,and the other technique during the second exercise. The resultsdid not confirm the hypotheses. On average, subjects worked moreefficiently when using off-line guidance, preferred off-lineguidance, and ignored quantitative quality models. Post hoc analysisidentified a strong correlation between subject experience leveland preference for the type of guidance, a result that deservesfurther investigation.