Jiminy: a scalable incentive-based architecture for improving rating quality

  • Authors:
  • Evangelos Kotsovinos;Petros Zerfos;Nischal M. Piratla;Niall Cameron;Sachin Agarwal

  • Affiliations:
  • Deutsche Telekom Laboratories, Berlin, Germany;Deutsche Telekom Laboratories, Berlin, Germany;Deutsche Telekom Laboratories, Berlin, Germany;Pembroke College, Cambridge, UK;Deutsche Telekom Laboratories, Berlin, Germany

  • Venue:
  • iTrust'06 Proceedings of the 4th international conference on Trust Management
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present the design, implementation, and evaluation of Jiminy: a framework for explicitly rewarding users who participate in reputation management systems by submitting ratings. To defend against participants who submit random or malicious ratings in order to accumulate rewards, Jiminy facilitates a probabilistic mechanism to detect dishonesty and halt rewards accordingly. Jiminy's reward model and honesty detection algorithm are presented and its cluster-based implementation is described. The proposed framework is evaluated using a large sample of real-world user ratings in order to demonstrate its effectiveness. Jiminy's performance and scalability are analysed through experimental evaluation. The system is shown to scale linearly with the on-demand addition of slave machines to the Jiminy cluster, allowing it to successfully process large problem spaces.