Quality assurance for human-based electronic services: a decision matrix for choosing the right approach

Authors:
Robert Kern;Hans Thies;Cordula Bauer;Gerhard Satzger
Affiliations:
Karlsruhe Institute of Technology, Karlsruhe Service Research Institute, Karlsruhe, Germany;Karlsruhe Institute of Technology, Karlsruhe Service Research Institute, Karlsruhe, Germany;Karlsruhe Institute of Technology, Karlsruhe Service Research Institute, Karlsruhe, Germany;Karlsruhe Institute of Technology, Karlsruhe Service Research Institute, Karlsruhe, Germany
Venue:
ICWE'10 Proceedings of the 10th international conference on Current trends in web engineering
Year:
2010

Citing 3
Cited 3

The Wisdom of Crowds

The Wisdom of Crowds
AI Gets a Brain

Queue - AI
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing

Towards a research agenda for enterprise crowdsourcing

ISoLA'10 Proceedings of the 4th international conference on Leveraging applications of formal methods, verification, and validation - Volume Part I
Quality control for real-time ubiquitous crowdsourcing

Proceedings of the 2nd international workshop on Ubiquitous crowdsouring
From sensing to controlling: the state of the art in ubiquitous crowdsourcing

International Journal of Communication Networks and Distributed Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Crowdsourcing in the form of human-based electronic services provides a powerful way of outsourcing so called human intelligence tasks (HITs) to a large workforce of people over the Internet. Because of the limited control over that workforce, it is challenging to ensure the quality of the work results. Several approaches have been proposed that can be applied to specific types of HITs. However, it is difficult to identify a suitable quality management approach for any given type of HIT. This paper aims to provide a first sketch of a decision matrix.