End-user debugging strategies: A sensemaking perspective

Authors:
Valentina Grigoreanu;Margaret Burnett;Susan Wiedenbeck;Jill Cao;Kyle Rector;Irwin Kwan
Affiliations:
Microsoft Corporation and Oregon State University, Corvallis, OR;Oregon State University, Corvallis, OR;Drexel University, PA;Oregon State University, Corvallis, OR;Oregon State University, Corvallis, OR 97331;Oregon State University, Corvallis, OR 97331
Venue:
ACM Transactions on Computer-Human Interaction (TOCHI)
Year:
2012

Citing 41
Cited 3

Instructionless learning about a complex device: the paradigm and observations

International Journal of Man-Machine Studies
Mental models and software maintenance

Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers
An analysis of the on-line debugging process

Empirical studies of programmers: second workshop
Where should the person stop and the information search interface start?

Information Processing and Management: an International Journal
A small matter of programming: perspectives on end user computing

A small matter of programming: perspectives on end user computing
The cost structure of sensemaking

CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Does continuous visual feedback aid debugging in direct-manipulation programming systems?

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
What we know about spreadsheet errors

Journal of End User Computing - End User Development
Software Defect Reduction Top 10 List

Computer
End-user software engineering with assertions in the spreadsheet paradigm

Proceedings of the 25th International Conference on Software Engineering
Is This Spreadsheet a Tax Evader? How H.M. Customs and Excise Test Spreadsheet Applications

HICSS '00 Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 4 - Volume 4
How self-efficacy and gender issues affect software adoption and use

Communications of the ACM - Why CS students need math
Supporting user hypotheses in problem diagnosis

Proceedings of the 9th international conference on Intelligent user interfaces
Designing the whyline: a debugging interface for asking questions about program behavior

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
End-user software engineering

Communications of the ACM - End-user development: tools that empower users to create their own software solutions
Six Learning Barriers in End-User Programming Systems

VLHCC '04 Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing
Effectiveness of end-user debugging software features: are there gender issues?

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Making sense of sensemaking

CHI '05 Extended Abstracts on Human Factors in Computing Systems
The EUSES spreadsheet corpus: a shared resource for supporting experimentation with spreadsheet dependability mechanisms

WEUSE I Proceedings of the first workshop on End-user software engineering
Lowering the barriers to programming: A taxonomy of programming environments and languages for novice programmers

ACM Computing Surveys (CSUR)
Garbage in, Garbage out? An Empirical Look at Oracle Mistakes by End-User Programmers

VLHCC '05 Proceedings of the 2005 IEEE Symposium on Visual Languages and Human-Centric Computing
Estimating the Numbers of End Users and End User Programmers

VLHCC '05 Proceedings of the 2005 IEEE Symposium on Visual Languages and Human-Centric Computing
Tinkering and gender in end-user programmers' debugging

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Invited research overview: end-user programming

CHI '06 Extended Abstracts on Human Factors in Computing Systems
Supporting end-user debugging: what do users want to know?

Proceedings of the working conference on Advanced visual interfaces
Strategies and behaviors of end-user programmers with interactive fault localization

HCC '03 Proceedings of the 2003 IEEE Symposium on Human Centric Computing Languages and Environments
Programming at runtime: requirements and paradigms for nonprogrammer web application development

HCC '03 Proceedings of the 2003 IEEE Symposium on Human Centric Computing Languages and Environments
Making Sense of Sensemaking 1: Alternative Perspectives

IEEE Intelligent Systems
Gender Differences in End-User Debugging, Revisited: What the Miners Found

VLHCC '06 Proceedings of the Visual Languages and Human-Centric Computing
Storytelling alice motivates middle school girls to learn computer programming

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Debugging strategies and tactics in a multi-representation software environment

International Journal of Human-Computer Studies
On to the Real World: Gender and Self-Efficacy in Excel

VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing
Design Planning in End-User Web Development

VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing
A Type System Based on End-User Vocabulary

VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing
Testing vs. code inspection vs. what else?: male and female end users' debugging strategies

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using information scent to model the dynamic foraging behavior of programmers in maintenance tasks

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Self-interruption on the computer: a typology of discretionary task interleaving

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Males' and Females' Script Debugging Strategies

IS-EUD '09 Proceedings of the 2nd International Symposium on End-User Development
Using scalable game design to promote 3D fluency: Assessing the AgentCubes incremental 3D end-user development framework

VLHCC '08 Proceedings of the 2008 IEEE Symposium on Visual Languages and Human-Centric Computing
Can feature design reduce the gender gap in end-user software development environments?

VLHCC '08 Proceedings of the 2008 IEEE Symposium on Visual Languages and Human-Centric Computing
Mining problem-solving strategies from HCI data

ACM Transactions on Computer-Human Interaction (TOCHI)

Reactive information foraging: an empirical investigation of theory-based recommender systems for programmers

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The whats and hows of programmers' foraging diets

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Social influences on secure development tool adoption: why security tools spread

Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Despite decades of research into how professional programmers debug, only recently has work emerged about how end-user programmers attempt to debug programs. Without this knowledge, we cannot build tools to adequately support their needs. This article reports the results of a detailed qualitative empirical study of end-user programmers' sensemaking about a spreadsheet's correctness. Using our study's data, we derived a sensemaking model for end-user debugging and categorized participants' activities and verbalizations according to this model, allowing us to investigate how participants went about debugging. Among the results are identification of the prevalence of information foraging during end-user debugging, two successful strategies for traversing the sensemaking model, potential ties to gender differences in the literature, sensemaking sequences leading to debugging progress, and sequences tied with troublesome points in the debugging process. The results also reveal new implications for the design of spreadsheet tools to support end-user programmers' sensemaking during debugging.