Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Automatic image annotation and retrieval using cross-media relevance models
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Face recognition: A literature survey
ACM Computing Surveys (CSUR)
Labeling images with a computer game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Peekaboom: a game for locating objects in images
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-time computerized annotation of pictures
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Designing human-computer multi-agent collaboration in productive multi-player games
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3
A Game-Theoretic Analysis of Games with a Purpose
WINE '08 Proceedings of the 4th International Workshop on Internet and Network Economics
Designing incentives for online question and answer forums
Proceedings of the 10th ACM conference on Electronic commerce
The role of game theory in human computation systems
Proceedings of the ACM SIGKDD Workshop on Human Computation
On formal models for social verification
Proceedings of the ACM SIGKDD Workshop on Human Computation
A crowdsourceable QoE evaluation framework for multimedia content
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Emerging theories and models of human computation systems: a brief survey
Proceedings of the 2nd international workshop on Ubiquitous crowdsouring
Capability-aligned matching: improving quality of games with a purpose
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Social networks profile mapping using games
WebApps'12 Proceedings of the 3rd USENIX conference on Web Application Development
A game-theoretic analysis of the ESP game
ACM Transactions on Economics and Computation - Inaugural Issue
From sensing to controlling: the state of the art in ubiquitous crowdsourcing
International Journal of Communication Networks and Distributed Systems
| Hi-index | 0.00 |
Multimedia content presents special challenges for the search engines, and could benefit from semantic annotation of images. Unfortunately, manual labeling is too tedious and time-consuming for humans, whereas automatic image annotation is too difficult for the computers. In this paper, we explore the power of human computation by designing a multi-player online game, PhotoSlap, to achieve the task of annotating metadata for a collection of digital photos. PhotoSlap engages users in an interactive game that capitalizes on human ability in deciphering quickly whether the same person shows up in two consecutive images presented by the computer. The game mechanism supports the objection and trap actions to encourage truthful input from the players. This research extends human computation research in two aspects: game-theoretic design principles and quantitative evaluation metrics. In particular, PhotoSlap can be shown to reach subgame perfect equilibrium with the target strategy when players are rational and without collusion. Experiments involving four focus groups have been conducted, and the preliminary results demonstrated the game to be fun and effective in annotating people metadata for photo collections.