MobileWorks: Designing for Quality in a Managed Crowdsourcing Architecture

Authors:
Anand Kulkarni;Philipp Gutheim;Prayag Narula;Dave Rolnitzky;Tapan Parikh;Bjorn Hartmann
Affiliations:
MobileWorks and University of California, Berkeley;MobileWorks and University of California, Berkeley;MobileWorks and University of California, Berkeley;MobileWorks;University of California, Berkeley;University of California, Berkeley
Venue:
IEEE Internet Computing
Year:
2012

Citing 0
Cited 3

The future of crowd work

Proceedings of the 2013 conference on Computer supported cooperative work
Crowdsourcing for information retrieval: introduction to the special issue

Information Retrieval
Reviewing versus doing: learning and performance in crowd assessment

Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Online labor marketplaces offer the potential to automate tasks too difficult for computers, but don't always provide accurate results. MobileWorks is a crowd platform that departs from the marketplace model to provide robust, high-accuracy results using three new techniques. A dynamic work-routing system identifies expertise in the crowd and ensures that posted work completes within a bounded time with fair wages. A peer-management system helps prevent wrong answers. Last, social interaction techniques let best workers manage and teach other crowd members. This process allows the crowd to collaboratively learn how to solve new tasks.