A comparative user study on rating vs. personality quiz based preference elicitation methods

  • Authors:
  • Rong Hu;Pearl Pu

  • Affiliations:
  • Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland;Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland

  • Venue:
  • Proceedings of the 14th international conference on Intelligent user interfaces
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We conducted a user study evaluating two preference elicitation approaches based on ratings and personality quizzes respectively. Three criteria were used in this comparative study: perceived accuracy, user effort and user loyalty. Results from our study show that the perceived accuracy in two systems is not significantly different. However, users expended significantly less effort, both perceived cognitive effort and actual task time, to complete the preference profile establishing process in the personality quiz-based system than in the rating-based system. Additionally, users expressed stronger intention to reuse the personality quiz-based system and introduce it to their friends. After using these two systems, 53% of users preferred the personality quiz-based system vs. 13% of users preferred the rating-based system, since most users thought the former is easier to use.