The impact of tutorials on games of varying complexity

Authors:
Erik Andersen;Eleanor O'Rourke;Yun-En Liu;Rich Snider;Jeff Lowdermilk;David Truong;Seth Cooper;Zoran Popovic
Affiliations:
University of Washington, Seattle, Washington, United States;University of Washington, Seattle, Washington, United States;University of Washington, Seattle, Washington, United States;University of Washington, Seattle, Washington, United States;University of Washington, Seattle, Washington, United States;University of Washington, Seattle, Washington, United States;University of Washington, Seattle, Washington, United States;University of Washington, Seattle, Washington, United States
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2012

Citing 16
Cited 6

Designing the user interface: strategies for effective human-computer interaction

Designing the user interface: strategies for effective human-computer interaction
An evaluation of animated demonstrations of learning computer-based tasks

CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The role of balloon help

ACM SIGDOC Asterisk Journal of Computer Documentation
Apple guide: a case study in user-aided design of online help

CHI '95 Conference Companion on Human Factors in Computing Systems
A comparison of still, animated, or nonillustrated on-line help with written or spoken instructions in a graphical user interface

CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usability Engineering

Usability Engineering
Sheepdog: learning procedures for technical support

Proceedings of the 9th international conference on Intelligent user interfaces
Stencils-based tutorials: design and evaluation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
DocWizards: a system for authoring follow-me documentation wizards

Proceedings of the 18th annual ACM symposium on User interface software and technology
Practical guide to controlled experiments on the web: listen to your customers not to the hippo

Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
Graphstract: minimal graphical help for computers

Proceedings of the 20th annual ACM symposium on User interface software and technology
A survey of software learnability: metrics, methodologies and guidelines

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Generating photo manipulation tutorials by demonstration

ACM SIGGRAPH 2009 papers
ToolClips: an investigation of contextual video assistance for functionality understanding

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Placing a value on aesthetics in online casual games

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
On the harmfulness of secondary game objectives

Proceedings of the 6th International Conference on Foundations of Digital Games

Optimizing adaptivity in educational games

Proceedings of the International Conference on the Foundations of Digital Games
Nanogenetic learning analytics: illuminating student learning pathways in an online fraction game

Proceedings of the Third International Conference on Learning Analytics and Knowledge
EEG-based assessment of video and in-game learning

CHI '13 Extended Abstracts on Human Factors in Computing Systems
In search of learning: facilitating data analysis in educational games

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A trace-based framework for analyzing and synthesizing educational progressions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Hint systems may negatively impact performance in educational games

Proceedings of the first ACM conference on Learning @ scale conference

Quantified Score

Hi-index	0.01

Visualization

Abstract

One of the key challenges of video game design is teaching new players how to play. Although game developers frequently use tutorials to teach game mechanics, little is known about how tutorials affect game learnability and player engagement. Seeking to estimate this value, we implemented eight tutorial designs in three video games of varying complexity and evaluated their effects on player engagement and retention. The results of our multivariate study of over 45,000 players show that the usefulness of tutorials depends greatly on game complexity. Although tutorials increased play time by as much as 29% in the most complex game, they did not significantly improve player engagement in the two simpler games. Our results suggest that investment in tutorials may not be justified for games with mechanics that can be discovered through experimentation.