Models and languages for parallel computation
ACM Computing Surveys (CSUR)
The anatomy of a large-scale hypertextual Web search engine
WWW7 Proceedings of the seventh international conference on World Wide Web 7
Communicating and mobile systems: the &pgr;-calculus
Communicating and mobile systems: the &pgr;-calculus
Future Generation Computer Systems
Analyzing the economic efficiency of eBay-like online reputation reporting mechanisms
Proceedings of the 3rd ACM conference on Electronic Commerce
Distributed Work
The Cathedral and the Bazaar
Participatory Design: Issues and Concerns
Computer Supported Cooperative Work
Workflow Automation: Overview and Research Issues
Information Systems Frontiers
Distributed and Parallel Databases
IPTPS '01 Revised Papers from the First International Workshop on Peer-to-Peer Systems
A Hierarchical Proxy Architecture for Internet-Scale Event Services
WETICE '99 Proceedings of the 8th Workshop on Enabling Technologies on Infrastructure for Collaborative Enterprises
Labeling images with a computer game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Supporting Reflective Practitioners
Proceedings of the 26th International Conference on Software Engineering
A taxonomy of scientific workflow systems for grid computing
ACM SIGMOD Record
The Wisdom of Crowds
When Computers Were Human
Becoming Wikipedian: transformation of participation in a collaborative online encyclopedia
GROUP '05 Proceedings of the 2005 international ACM SIGGROUP conference on Supporting group work
The Wealth of Networks: How Social Production Transforms Markets and Freedom
The Wealth of Networks: How Social Production Transforms Markets and Freedom
Motivations of contributors to Wikipedia
ACM SIGCAS Computers and Society
Crowdsourcing user studies with Mechanical Turk
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Get another label? improving data quality and data mining using multiple, noisy labelers
Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
Towards Collaborative Intelligent Tutors: Automated Recognition of Users' Strategies
ITS '08 Proceedings of the 9th international conference on Intelligent Tutoring Systems
Can you ever trust a wiki?: impacting perceived trustworthiness in wikipedia
Proceedings of the 2008 ACM conference on Computer supported cooperative work
Coordination in collective intelligence: the role of team structure and task interdependence
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Financial incentives and the "performance of crowds"
Proceedings of the ACM SIGKDD Workshop on Human Computation
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Fast, cheap, and creative: evaluating translation quality using Amazon's Mechanical Turk
EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Are your participants gaming the system?: screening mechanical turk workers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Who are the crowdworkers?: shifting demographics in mechanical turk
CHI '10 Extended Abstracts on Human Factors in Computing Systems
CAPTCHA: using hard AI problems for security
EUROCRYPT'03 Proceedings of the 22nd international conference on Theory and applications of cryptographic techniques
BPM'07 Proceedings of the 5th international conference on Business process management
The labor economics of paid crowdsourcing
Proceedings of the 11th ACM conference on Electronic commerce
Task search in a human computation market
Proceedings of the ACM SIGKDD Workshop on Human Computation
The anatomy of a large-scale human computation engine
Proceedings of the ACM SIGKDD Workshop on Human Computation
Sellers' problems in human computation markets
Proceedings of the ACM SIGKDD Workshop on Human Computation
Quality management on Amazon Mechanical Turk
Proceedings of the ACM SIGKDD Workshop on Human Computation
TurKit: human computation algorithms on mechanical turk
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Soylent: a word processor with a crowd inside
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
VizWiz: nearly real-time answers to visual questions
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Creating speech and language data with Amazon's Mechanical Turk
CSLDAMT '10 Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk
Crowdsourcing, collaboration and creativity
XRDS: Crossroads, The ACM Magazine for Students - Comp-YOU-Ter
Ethics and tactics of professional crowdwork
XRDS: Crossroads, The ACM Magazine for Students - Comp-YOU-Ter
Reflecting on the DARPA Red Balloon Challenge
Communications of the ACM
Evaluating and improving the usability of Mechanical Turk for low-income workers in India
Proceedings of the First ACM Symposium on Computing for Development
Appropriation and Creativity: User-Initiated Contests in Scratch
HICSS '11 Proceedings of the 2011 44th Hawaii International Conference on System Sciences
Designing incentives for inexpert human raters
Proceedings of the ACM 2011 conference on Computer supported cooperative work
Searching for Jim Gray: a technical overview
Communications of the ACM
Affective computational priming and creativity
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Cooks or cobblers?: crowd creativity through combination
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Human computation: a survey and taxonomy of a growing field
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Identifying shared leadership in Wikipedia
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Web workers unite! addressing challenges of online laborers
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Turkomatic: automatic recursive task and workflow design for mechanical turk
CHI '11 Extended Abstracts on Human Factors in Computing Systems
CrowdDB: answering queries with crowdsourcing
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Platemate: crowdsourcing nutritional analysis from food photographs
Proceedings of the 24th annual ACM symposium on User interface software and technology
Instrumenting the crowd: using implicit behavioral measures to predict task performance
Proceedings of the 24th annual ACM symposium on User interface software and technology
Real-time crowd control of existing interfaces
Proceedings of the 24th annual ACM symposium on User interface software and technology
Crowds in two seconds: enabling realtime crowd-powered interfaces
Proceedings of the 24th annual ACM symposium on User interface software and technology
CrowdForge: crowdsourcing complex work
Proceedings of the 24th annual ACM symposium on User interface software and technology
The jabberwocky programming environment for structured social computing
Proceedings of the 24th annual ACM symposium on User interface software and technology
Communications of the ACM
Shepherding the crowd yields better work
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
CrowdWeaver: visually managing complex crowd work
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
Online team formation in social networks
Proceedings of the 21st international conference on World Wide Web
Human computation tasks with global constraints
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
mClerk: enabling mobile crowdsourcing in developing regions
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CommunitySourcing: engaging local crowds to perform expert work via physical kiosks
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Micro perceptual human computation for visual tasks
ACM Transactions on Graphics (TOG)
10,000 gold for 20 dollars: an exploratory study of World of Warcraft gold buyers
Proceedings of the International Conference on the Foundations of Digital Games
Combining human and machine intelligence in large-scale crowdsourcing
Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
CrowdScape: interactively visualizing user behavior and output
Proceedings of the 25th annual ACM symposium on User interface software and technology
MobileWorks: Designing for Quality in a Managed Crowdsourcing Architecture
IEEE Internet Computing
An internet-scale idea generation system
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special section on internet-scale human problem solving and regular papers
Proceedings of the VLDB Endowment
Proceedings of the 2013 conference on Computer supported cooperative work companion
Crowdsourcing for information retrieval: introduction to the special issue
Information Retrieval
Understanding crowdfunding work: implications for support tools
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
interactions
Software aims to ensure fairness in crowdsourcing projects
Communications of the ACM
Keep it simple: reward and task design in crowdsourcing
Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI
Chorus: a crowd-powered conversational assistant
Proceedings of the 26th annual ACM symposium on User interface software and technology
Peer and self assessment in massive online classes
ACM Transactions on Computer-Human Interaction (TOCHI)
TaskGenies: Automatically Providing Action Plans Helps People Complete Tasks
ACM Transactions on Computer-Human Interaction (TOCHI)
Voyant: generating structured feedback on visual designs using a crowd of non-experts
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
The motivations and experiences of the on-demand mobile workforce
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Collaborative problem solving: a study of MathOverflow
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Remote shopping advice: enhancing in-store shopping with social technologies
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Understanding the role of community in crowdfunding work
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
A comparison of social, learning, and financial strategies on crowd engagement and output quality
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Information extraction and manipulation threats in crowd-powered systems
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Back to the future of organizational work: crowdsourcing and digital work marketplaces
Proceedings of the companion publication of the 17th ACM conference on Computer supported cooperative work & social computing
Sharing Knowledge and Expertise: The CSCW View of Knowledge Management
Computer Supported Cooperative Work
Expert Systems with Applications: An International Journal
Hi-index | 0.02 |
Paid crowd work offers remarkable opportunities for improving productivity, social mobility, and the global economy by engaging a geographically distributed workforce to complete complex tasks on demand and at scale. But it is also possible that crowd work will fail to achieve its potential, focusing on assembly-line piecework. Can we foresee a future crowd workplace in which we would want our children to participate? This paper frames the major challenges that stand in the way of this goal. Drawing on theory from organizational behavior and distributed computing, as well as direct feedback from workers, we outline a framework that will enable crowd work that is complex, collaborative, and sustainable. The framework lays out research challenges in twelve major areas: workflow, task assignment, hierarchy, real-time response, synchronous collaboration, quality control, crowds guiding AIs, AIs guiding crowds, platforms, job design, reputation, and motivation.