Utility of human-computer interactions: toward a science of preference measurement

Authors:
Michael Toomim;Travis Kriplean;Claus Pörtner;James Landay
Affiliations:
University of Washington & Microsoft Research Asia , Seattle, Washington, USA;University of Washington, Seattle, Washington, USA;University of Washington, Seattle, Washington, USA;University of Washington & Microsoft Resesarch , Seattle, Washington, USA
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2011

Citing 8
Cited 8

Labeling images with a computer game

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Economic and subjective measures of the perceived value of aesthetics and usability

ACM Transactions on Computer-Human Interaction (TOCHI)
Practical guide to controlled experiments on the web: listen to your customers not to the hippo

Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
Crowdsourcing user studies with Mechanical Turk

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Crowdsourcing graphical perception: using mechanical turk to assess visualization design

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Who are the crowdworkers?: shifting demographics in mechanical turk

CHI '10 Extended Abstracts on Human Factors in Computing Systems
The labor economics of paid crowdsourcing

Proceedings of the 11th ACM conference on Electronic commerce
Quality management on Amazon Mechanical Turk

Proceedings of the ACM SIGKDD Workshop on Human Computation

Real-time crowd control of existing interfaces

Proceedings of the 24th annual ACM symposium on User interface software and technology
Crowds in two seconds: enabling realtime crowd-powered interfaces

Proceedings of the 24th annual ACM symposium on User interface software and technology
Correct horse battery staple: exploring the usability of system-assigned passphrases

Proceedings of the Eighth Symposium on Usable Privacy and Security
How does your password measure up? the effect of strength meters on password creation

Security'12 Proceedings of the 21st USENIX conference on Security symposium
Real-time crowd labeling for deployable activity recognition

Proceedings of the 2013 conference on Computer supported cooperative work
An internet-scale idea generation system

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special section on internet-scale human problem solving and regular papers
The cost of annoying ads

Proceedings of the 22nd international conference on World Wide Web
The usability perception scale (UPscale): a measure for evaluating feedback displays

DUXU'13 Proceedings of the Second international conference on Design, User Experience, and Usability: design philosophy, methods, and tools - Volume Part I

Quantified Score

Hi-index	0.01

Visualization

Abstract

The success of a computer system depends upon a user choosing it, but the field of Human-Computer Interaction has little ability to predict this user choice. We present a new method that measures user choice, and quantifies it as a measure of utility. Our method has two core features. First, it introduces an economic definition of utility, one that we can operationalize through economic experiments. Second, we employ a novel method of crowdsourcing that enables the collection of thousands of economic judgments from real users.