Combinatorial pair testing: distinguishing workers from slackers

  • Authors:
  • David Eppstein;Michael T. Goodrich;Daniel S. Hirschberg

  • Affiliations:
  • Dept. of Computer Science, University of California, Irvine, CA;Dept. of Computer Science, University of California, Irvine, CA;Dept. of Computer Science, University of California, Irvine, CA

  • Venue:
  • WADS'13 Proceedings of the 13th international conference on Algorithms and Data Structures
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

We formalize a problem we call combinatorial pair testing (CPT), which has applications to the identification of uncooperative or unproductive participants in pair programming, massively distributed computing, and crowdsourcing environments. We give efficient adaptive and nonadaptive CPT algorithms and we show that our methods use an optimal number of testing rounds to within constant factors. We also provide an empirical evaluation of some of our methods.