Quality Control in Crowdsourcing Systems: Issues and Directions

  • Authors:
  • Mohammad Allahbakhsh;Boualem Benatallah;Aleksandar Ignjatovic;Hamid Reza Motahari-Nezhad;Elisa Bertino;Schahram Dustdar

  • Affiliations:
  • University of New South Wales;University of New South Wales;University of New South Wales;Hewlett-Packard Laboratories;Purdue University;Technical University of Vienna

  • Venue:
  • IEEE Internet Computing
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

As a new distributed computing model, crowdsourcing lets people leverage the crowd's intelligence and wisdom toward solving problems. This article proposes a framework for characterizing various dimensions of quality control in crowdsourcing systems, a critical issue. The authors briefly review existing quality-control approaches, identify open issues, and look to future research directions. In the Web extra, the authors discuss both design-time and runtime approaches in more detail.