Programming languages for distributed computing systems
ACM Computing Surveys (CSUR)
The interdisciplinary study of coordination
ACM Computing Surveys (CSUR)
Electronic markets and electronic hierarchies
Communications of the ACM
Models and languages for parallel computation
ACM Computing Surveys (CSUR)
Dryad: distributed data-parallel programs from sequential building blocks
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
MapReduce: simplified data processing on large clusters
Communications of the ACM - 50th anniversary issue: 1958 - 2008
Crowdsourcing user studies with Mechanical Turk
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pig latin: a not-so-foreign language for data processing
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Harnessing the wisdom of crowds in wikipedia: quality through coordination
Proceedings of the 2008 ACM conference on Computer supported cooperative work
Coordination in collective intelligence: the role of team structure and task interdependence
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
How well do line drawings depict shape?
ACM SIGGRAPH 2009 papers
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Fast, cheap, and creative: evaluating translation quality using Amazon's Mechanical Turk
EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Crowdsourcing graphical perception: using mechanical turk to assess visualization design
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
TurKit: human computation algorithms on mechanical turk
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Briefing news reporting with mobile assignments: perceptions, needs and challenges
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
Collaboratively crowdsourcing workflows with turkomatic
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
CrowdWeaver: visually managing complex crowd work
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
Human computation tasks with global constraints
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-time captioning by groups of non-experts
Proceedings of the 25th annual ACM symposium on User interface software and technology
CrowdScape: interactively visualizing user behavior and output
Proceedings of the 25th annual ACM symposium on User interface software and technology
Proceedings of the 3rd Annual ACM Web Science Conference
CrowdLang: a programming language for the systematic exploration of human computation systems
SocInfo'12 Proceedings of the 4th international conference on Social Informatics
Enhancing reliability using peer consistency evaluation in human computation
Proceedings of the 2013 conference on Computer supported cooperative work
Crowd vs. crowd: large-scale cooperative design through open team competition
Proceedings of the 2013 conference on Computer supported cooperative work
Proceedings of the 2013 conference on Computer supported cooperative work
Wally: crowd powered image matching on tablets
Proceedings of the First International Workshop on Crowdsourcing and Data Mining
Leveraging transitive relations for crowdsourced joins
Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
Cascade: crowdsourcing taxonomy creation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Chorus: a crowd-powered conversational assistant
Proceedings of the 26th annual ACM symposium on User interface software and technology
TaskGenies: Automatically Providing Action Plans Helps People Complete Tasks
ACM Transactions on Computer-Human Interaction (TOCHI)
The motivations and experiences of the on-demand mobile workforce
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Collaborative problem solving: a study of MathOverflow
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Reviewing versus doing: learning and performance in crowd assessment
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
A comparison of social, learning, and financial strategies on crowd engagement and output quality
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Maximum Complex Task Assignment: Towards Tasks Correlation in Spatial Crowdsourcing
Proceedings of International Conference on Information Integration and Web-based Applications & Services
Hi-index | 0.00 |
Micro-task markets such as Amazon's Mechanical Turk represent a new paradigm for accomplishing work, in which employers can tap into a large population of workers around the globe to accomplish tasks in a fraction of the time and money of more traditional methods. However, such markets have been primarily used for simple, independent tasks, such as labeling an image or judging the relevance of a search result. Here we present a general purpose framework for accomplishing complex and interdependent tasks using micro-task markets. We describe our framework, a web-based prototype, and case studies on article writing, decision making, and science journalism that demonstrate the benefits and limitations of the approach.