It is about time: time aware quality management for interactive systems with humans in the loop

  • Authors:
  • Markus Krause;Robert Porzel

  • Affiliations:
  • University of Hannover, Hannover, Germany;University of Bremen, Bremen, Bremen, Germany

  • Venue:
  • CHI '13 Extended Abstracts on Human Factors in Computing Systems
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

In recent years crowd-based and human computation systems have attracted increasing attention in science and industry. For applications that are driven by input from a multitude of human raters, ensuring data reliability and organizing an interactive workflow constitute a new challenge. In this paper we describe a novel approach to ensure data quality in crowd-based and human computation systems. The proposed algorithm features the potential for direct feedback and interactivity while producing little computational overhead.