Improving accessibility of the web with a computer game

Authors:
Luis von Ahn;Shiry Ginosar;Mihir Kedia;Ruoran Liu;Manuel Blum
Affiliations:
Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2006

Citing 2
Cited 31

Labeling images with a computer game

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An analysis of the AskMSR question-answering system

EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10

Peekaboom: a game for locating objects in images

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The changing face of web search: algorithms, auctions and advertising

Proceedings of the thirty-eighth annual ACM symposium on Theory of computing
WebInSight:: making web images accessible

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Increasing web accessibility by automatically judging alternative text quality

Proceedings of the 12th international conference on Intelligent user interfaces
Towards human-like spoken dialogue systems

Speech Communication
Mobile multimodality: a theoretical approach to facilitate virtual device environments

Mobile Networks and Applications
A comprehensive human computation framework: with application to image labeling

MM '08 Proceedings of the 16th ACM international conference on Multimedia
A Game-Theoretic Analysis of Games with a Purpose

WINE '08 Proceedings of the 4th International Workshop on Internet and Network Economics
The role of game theory in human computation systems

Proceedings of the ACM SIGKDD Workshop on Human Computation
The transition from web content accessibility guidelines 1.0 to 2.0: what this means for evaluation and repair

Proceedings of the 27th ACM international conference on Design of communication
TextSL: a command-based virtual world interface for the visually impaired

Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Improving search engines using human computation games

Proceedings of the 18th ACM conference on Information and knowledge management
Image annotation through gaming (TAG4FUN)

DSP'09 Proceedings of the 16th international conference on Digital Signal Processing
The participation payoff: challenges and opportunities for multimedia access in networked communities

Proceedings of the international conference on Multimedia information retrieval
Vlogging: A survey of videoblogging technology on the web

ACM Computing Surveys (CSUR)
Exploring iterative and parallel human computation processes

CHI '10 Extended Abstracts on Human Factors in Computing Systems
Hit me baby one more time: a haptic rating interface

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques
On intelligent interface agents for human based computation

IDEAL'07 Proceedings of the 8th international conference on Intelligent data engineering and automated learning
OntoGame: towards overcoming the incentive bottleneck in ontology building

OTM'07 Proceedings of the 2007 OTM Confederated international conference on On the move to meaningful internet systems - Volume Part II
OntoGame: weaving the semantic web by online games

ESWC'08 Proceedings of the 5th European semantic web conference on The semantic web: research and applications
Exploring iterative and parallel human computation processes

Proceedings of the ACM SIGKDD Workshop on Human Computation
Seek-n-Tag: a game for labeling and classifying virtual world objects

Proceedings of Graphics Interface 2010
Crowdsourcing human-based computation

Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
RISQ! Renowned Individuals Semantic Quiz: a Jeopardy like quiz game for ranking facts

Proceedings of the 7th International Conference on Semantic Systems
Morphological annotation of a corpus with a collaborative multiplayer game

CICLing'10 Proceedings of the 11th international conference on Computational Linguistics and Intelligent Text Processing
GoFish: fishing thousand words worth a picture

IHCI'10 Proceedings of the 2010 international conference on Interaction Design & International Development
An analytical model for generalized ESP games

Knowledge-Based Systems
Purposeful gaming & socio-computational systems: a citizen science design case

Proceedings of the 17th ACM international conference on Supporting group work
A game-theoretic analysis of the ESP game

ACM Transactions on Economics and Computation - Inaugural Issue
Forgotten island: a story-driven citizen science adventure

CHI '13 Extended Abstracts on Human Factors in Computing Systems
Crowdsourcing MapReduce: JSMapReduce

Proceedings of the 22nd international conference on World Wide Web companion

Quantified Score

Hi-index	0.01

Visualization

Abstract

Images on the Web present a major accessibility issue for the visually impaired, mainly because the majority of them do not have proper captions. This paper addresses the problem of attaching proper explanatory text descriptions to arbitrary images on the Web. To this end, we introduce Phetch, an enjoyable computer game that collects explanatory descriptions of images. People play the game because it is fun, and as a side effect of game play we collect valuable information. Given any image from the World Wide Web, Phetch can output a correct annotation for it. The collected data can be applied towards significantly improving Web accessibility. In addition to improving accessibility, Phetch is an example of a new class of games that provide entertainment in exchange for human processing power. In essence, we solve a typical computer vision problem with HCI tools alone.