Labeling images with a computer game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Preference elicitation for interface optimization
Proceedings of the 18th annual ACM symposium on User interface software and technology
Peekaboom: a game for locating objects in images
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Verbosity: a game for collecting common-sense facts
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Input-agreement: a new mechanism for collecting data using human computation games
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Input-agreement: a new mechanism for collecting data using human computation games
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Thumbs-Up: a game for playing to rank search results
Proceedings of the ACM SIGKDD Workshop on Human Computation
The role of game theory in human computation systems
Proceedings of the ACM SIGKDD Workshop on Human Computation
On formal models for social verification
Proceedings of the ACM SIGKDD Workshop on Human Computation
Ranking mechanisms in twitter-like forums
Proceedings of the third ACM international conference on Web search and data mining
Curator: a game with a purpose for collection recommendation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sentence recall game: a novel tool for collecting data to discover language usage patterns
Proceedings of the ACM SIGKDD Workshop on Human Computation
Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - Adjunct
Five design challenges for human computation
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Eliciting risk perceptions with an online game: preliminary results
Proceedings of the ACM 2011 conference on Computer supported cooperative work
A weighted multi-factor algorithm for microblog search
AMT'11 Proceedings of the 7th international conference on Active media technology
Crowds in two seconds: enabling realtime crowd-powered interfaces
Proceedings of the 24th annual ACM symposium on User interface software and technology
Betterrelations: using a game to rate linked data triples
KI'11 Proceedings of the 34th Annual German conference on Advances in artificial intelligence
Proceedings of the fifth ACM international conference on Web search and data mining
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
Wisdom about the crowd: assuring geospatial data quality collected in location-based games
ICEC'11 Proceedings of the 10th international conference on Entertainment Computing
Declarative platform for data sourcing games
Proceedings of the 21st international conference on World Wide Web
Twiage: a game for finding good advice on twitter
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A game-theoretic analysis of the ESP game
ACM Transactions on Economics and Computation - Inaugural Issue
Information Technology and Management
Computer Vision and Image Understanding
Proceedings of the 23rd international conference on World wide web
| Hi-index | 0.01 |
Eliciting user preferences for large datasets and creating rankings based on these preferences has many practical applications in community-based sites. This paper gives a new method to elicit user preferences that does not ask users to tell what they prefer, but rather what a random person would prefer, and rewards them if their prediction is correct. We provide an implementation of our method as a two-player game in which each player is shown two images and asked to click on the image their partner would prefer. The game has proven to be enjoyable, has attracted tens of thousands of people and has already collected millions of judgments. We compare several algorithms for combining these relative judgments between pairs of images into a total ordering of all images and present a new algorithm to perform collaborative filtering on pair-wise relative judgments. In addition, we show how merely observing user preferences on a specially chosen set of images can predict a user's gender with high probability.