Automatic image annotation and retrieval using cross-media relevance models
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Labeling images with a computer game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Computer
tagging, communities, vocabulary, evolution
CSCW '06 Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work
Why we tag: motivations for annotation in mobile and online media
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 2007 international ACM conference on Supporting group work
Flickr tag recommendation based on collective knowledge
Proceedings of the 17th international conference on World Wide Web
Personalized, interactive tag recommendation for flickr
Proceedings of the 2008 ACM conference on Recommender systems
Social tagging revamped: supporting the users' need of self-promotion through persuasive techniques
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluating game genres for tagging images
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Automatic image semantic interpretation using social action and tagging data
Multimedia Tools and Applications
Performance and perceptions of human computation games for image tagging
Proceedings of the 2011 ACM Symposium on Applied Computing
Capability-aligned matching: improving quality of games with a purpose
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Perceptions, quality and motivational needs in image tagging human computation games
Journal of Information Science
Exploring the character of participation in social media: the case of Google Image Labeler
Proceedings of the 2012 iConference
Transcribing handwritten text images with a word soup game
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Squaring and scripting the ESP game: trimming a GWAP to deep semantics
SGDA'12 Proceedings of the Third international conference on Serious Games Development and Applications
Enhancing reliability using peer consistency evaluation in human computation
Proceedings of the 2013 conference on Computer supported cooperative work
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Crowd synthesis: extracting categories and clusters from complex data
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Quizz: targeted crowdsourcing with a billion (potential) users
Proceedings of the 23rd international conference on World wide web
| Hi-index | 0.00 |
The ESP Game was designed to harvest human intelligence to assign labels to images - a task which is still difficult for even the most advanced systems in image processing. However, the ESP Game as it is currently implemented encourages players to assign "obvious" labels, which can be easily predicted given previously assigned labels. We present a language model which can assign probabilities to the next label to be added. This model is then used in a program, which plays the ESP game without looking at the image. Even without any use of the actual image, the program manages to agree with the randomly assigned human partner on a label for 69% of all images, and for 81% of images which have at least one "off-limits" term assigned to them. We discuss how the scoring system and the design of the ESP game can be improved to encourage users to add less predictable labels, thereby improving the quality of the collected information.