The role of game theory in human computation systems

Authors:
Shaili Jain;David C. Parkes
Affiliations:
Harvard University, Cambridge, MA;Harvard University, Cambridge, MA
Venue:
Proceedings of the ACM SIGKDD Workshop on Human Computation
Year:
2009

Citing 17
Cited 13

Labeling images with a computer game

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Peekaboom: a game for locating objects in images

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Verbosity: a game for collecting common-sense facts

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Improving accessibility of the web with a computer game

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Efficiency and nash equilibria in a scrip system for P2P networks

EC '06 Proceedings of the 7th ACM conference on Electronic commerce
Designing games with a purpose

Communications of the ACM - Designing games with a purpose
Crowdsourcing and knowledge sharing: strategic user behavior on taskcn

Proceedings of the 9th ACM conference on Electronic commerce
Bittorrent is an auction: analyzing and improving bittorrent's incentives

Proceedings of the ACM SIGCOMM 2008 conference on Data communication
Facts or friends?: distinguishing informational and conversational questions in social Q&A sites

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Questions in, knowledge in?: a study of naver's question answering community

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Input-agreement: a new mechanism for collecting data using human computation games

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Matchin: eliciting user preferences with an online game

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Designing incentives for online question and answer forums

Proceedings of the 10th ACM conference on Electronic commerce
Policy teaching through reward function learning

Proceedings of the 10th ACM conference on Electronic commerce
On formal models for social verification

Proceedings of the ACM SIGKDD Workshop on Human Computation
PhotoSlap: a multi-player online game for semantic annotation

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Value-based policy teaching with active indirect elicitation

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 1

The labor economics of paid crowdsourcing

Proceedings of the 11th ACM conference on Electronic commerce
Sellers' problems in human computation markets

Proceedings of the ACM SIGKDD Workshop on Human Computation
Ethics and tactics of professional crowdwork

XRDS: Crossroads, The ACM Magazine for Students - Comp-YOU-Ter
Incentivizing high-quality user-generated content

Proceedings of the 20th international conference on World wide web
A game-theoretic analysis of rank-order mechanisms for user-generated content

Proceedings of the 12th ACM conference on Electronic commerce
Emerging theories and models of human computation systems: a brief survey

Proceedings of the 2nd international workshop on Ubiquitous crowdsouring
CyLog/Crowd4U: a declarative platform for complex data-centric crowdsourcing

Proceedings of the VLDB Endowment
Learning and incentives in user-generated content: multi-armed bandits with endogenous arms

Proceedings of the 4th conference on Innovations in Theoretical Computer Science
Perspectives on crowdsourcing annotations for natural language processing

Language Resources and Evaluation
An analysis of human factors and label accuracy in crowdsourcing relevance judgments

Information Retrieval
Linked data in crowdsourcing purposive social network

Proceedings of the 22nd international conference on World Wide Web companion
From sensing to controlling: the state of the art in ubiquitous crowdsourcing

International Journal of Communication Networks and Distributed Systems
Automatic annotation of image databases based on implicit crowdsourcing, visual concept modeling and evolution

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

The paradigm of "human computation" seeks to harness human abilities to solve computational problems or otherwise perform distributed work that is beyond the scope of current AI technologies. One aspect of human computation has become known as "games with a purpose" and seeks to elicit useful computational work in fun (typically) multi-player games. Human computation also encompasses distributed work (or "peer production") systems such as Wikipedia and Question and Answer forums. In this short paper, we survey existing game-theoretic models for various human computation designs, and outline research challenges in advancing a theory that can enable better design.