Designing a collective-intelligence system for evaluating complex, crowd-generated intellectual artifacts

  • Authors:
  • Yiftach Nagar

  • Affiliations:
  • Massachusetts Institute of Technology, Cambridge, MA, USA

  • Venue:
  • Proceedings of the 2013 conference on Computer supported cooperative work companion
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

The collective-intelligence of crowds is increasingly used to generate ideas, plans, designs and predictions, for addressing various challenges - from folding proteins to identifying galaxies. In many cases, evaluation of crowd inputs can be done by non-experts, or even automatically. However, evaluating some complex crowd-generated intellectual artifacts, such as plans for addressing climate change, requires high levels of expertise in multiple domains - a combination that is rare even on global scale. I am designing a sociotechnical solution for relieving the bottleneck of expertise. If successful, principles of this design might be transferable to other domains, including, perhaps, the review of scientific work.