ClearBoard: a seamless medium for shared drawing and conversation with eye contact
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usability Engineering
The Psychology of Human-Computer Interaction
The Psychology of Human-Computer Interaction
Labeling images with a computer game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
As-rigid-as-possible shape manipulation
ACM SIGGRAPH 2005 Papers
The Wisdom of Crowds
Computer
Matchin: eliciting user preferences with an online game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Financial incentives and the "performance of crowds"
Proceedings of the ACM SIGKDD Workshop on Human Computation
Proceedings of the seventh ACM conference on Creativity and cognition
Task search in a human computation market
Proceedings of the ACM SIGKDD Workshop on Human Computation
Exploring iterative and parallel human computation processes
Proceedings of the ACM SIGKDD Workshop on Human Computation
TurKit: human computation algorithms on mechanical turk
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Soylent: a word processor with a crowd inside
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
VizWiz: nearly real-time answers to visual questions
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Crowdsourcing, collaboration and creativity
XRDS: Crossroads, The ACM Magazine for Students - Comp-YOU-Ter
Utility of human-computer interactions: toward a science of preference measurement
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Shepherding the crowd: managing and providing feedback to crowd workers
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Execution control for crowdsourcing
Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology
CommunitySourcing: engaging local crowds to perform expert work via physical kiosks
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using real-time feedback to improve visual question answering
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Micro perceptual human computation for visual tasks
ACM Transactions on Graphics (TOG)
What next, ubicomp?: celebrating an intellectual disappearing act
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
A readability evaluation of real-time crowd captions in the classroom
Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
Online quality control for real-time crowd captioning
Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
The cost of collaboration for code and art: evidence from a remixing community
Proceedings of the 2013 conference on Computer supported cooperative work
Real-time crowd labeling for deployable activity recognition
Proceedings of the 2013 conference on Computer supported cooperative work
Proceedings of the 2013 conference on Computer supported cooperative work
Proceedings of the VLDB Endowment
Efficient crowdsourcing for multi-class labeling
Proceedings of the ACM SIGMETRICS/international conference on Measurement and modeling of computer systems
Warping time for more effective real-time crowdsourcing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Adaptive time windows for real-time crowd captioning
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Xpress: crowdsourcing native speakers to learn colloquial expressions in a second language
CHI '13 Extended Abstracts on Human Factors in Computing Systems
A pilot study of using crowds in the classroom
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-time trip planning with the crowd
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Finding action dependencies using the crowd
Proceedings of the seventh international conference on Knowledge capture
Crowdsourcing user interface adaptations for minimizing the bloat in enterprise applications
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
NLify: lightweight spoken natural language interfaces via exhaustive paraphrasing
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Chorus: a crowd-powered conversational assistant
Proceedings of the 26th annual ACM symposium on User interface software and technology
Voyant: generating structured feedback on visual designs using a crowd of non-experts
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Remote shopping advice: enhancing in-store shopping with social technologies
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
AskSheet: efficient human computation for decision making with spreadsheets
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Information extraction and manipulation threats in crowd-powered systems
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Accessibility Evaluation of Classroom Captions
ACM Transactions on Accessible Computing (TACCESS)
Proceedings of the 19th international conference on Intelligent User Interfaces
Hi-index | 0.00 |
Interactive systems must respond to user input within seconds. Therefore, to create realtime crowd-powered interfaces, we need to dramatically lower crowd latency. In this paper, we introduce the use of synchronous crowds for on-demand, realtime crowdsourcing. With synchronous crowds, systems can dynamically adapt tasks by leveraging the fact that workers are present at the same time. We develop techniques that recruit synchronous crowds in two seconds and use them to execute complex search tasks in ten seconds. The first technique, the retainer model, pays workers a small wage to wait and respond quickly when asked. We offer empirically derived guidelines for a retainer system that is low-cost and produces on-demand crowds in two seconds. Our second technique, rapid refinement, observes early signs of agreement in synchronous crowds and dynamically narrows the search space to focus on promising directions. This approach produces results that, on average, are of more reliable quality and arrive faster than the fastest crowd member working alone. To explore benefits and limitations of these techniques for interaction, we present three applications: Adrenaline, a crowd-powered camera where workers quickly filter a short video down to the best single moment for a photo; and Puppeteer and A|B, which examine creative generation tasks, communication with workers, and low-latency voting.