Voyant: generating structured feedback on visual designs using a crowd of non-experts

  • Authors:
  • Anbang Xu;Shih-Wen Huang;Brian Bailey

  • Affiliations:
  • University of Illinois at Urbana-Champaign, Urbana, IL, USA;University of Washington, Seattle, WA, USA;University of Illinois at Urbana-Champaign, Urbana, IL, USA

  • Venue:
  • Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

Feedback on designs is critical for helping users iterate toward effective solutions. This paper presents Voyant, a novel system giving users access to a non-expert crowd to receive perception-oriented feedback on their designs from a selected audience. Based on a formative study, the system generates the elements seen in a design, the order in which elements are noticed, impressions formed when the design is first viewed, and interpretation of the design relative to guidelines in the domain and the user's stated goals. An evaluation of the system was conducted with users and their designs. Users reported the feedback about impressions and interpretation of their goals was most helpful, though the other feedback types were also valued. Users found the coordinated views in Voyant useful for analyzing relations between the crowd's perception of a design and the visual elements within it. The cost of generating the feedback was considered a reasonable tradeoff for not having to organize critiques or interrupt peers.