Reputation and social network analysis in multi-agent systems
Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 1
The Eigentrust algorithm for reputation management in P2P networks
WWW '03 Proceedings of the 12th international conference on World Wide Web
Supporting Trust in Virtual Communities
HICSS '00 Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 6 - Volume 6
Detecting deception in reputation management
AAMAS '03 Proceedings of the second international joint conference on Autonomous agents and multiagent systems
Review on Computational Trust and Reputation Models
Artificial Intelligence Review
The Knowledge Engineering Review
Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
TRAVOS: Trust and Reputation in the Context of Inaccurate Information Sources
Autonomous Agents and Multi-Agent Systems
A survey of attack and defense techniques for reputation systems
ACM Computing Surveys (CSUR)
Generalized distances between rankings
Proceedings of the 19th international conference on World wide web
TRMSim-WSN, trust and reputation models simulator for wireless sensor networks
ICC'09 Proceedings of the 2009 IEEE international conference on Communications
TREET: the Trust and Reputation Experimentation and Evaluation Testbed
Electronic Commerce Research
A Model for a Testbed for Evaluating Reputation Systems
TRUSTCOM '11 Proceedings of the 2011IEEE 10th International Conference on Trust, Security and Privacy in Computing and Communications
Personalizing EigenTrust in the Face of Communities and Centrality Attack
AINA '12 Proceedings of the 2012 IEEE 26th International Conference on Advanced Information Networking and Applications
DART: A Distributed Analysis Of Reputation And Trust Framework
Computational Intelligence
Computational trust and reputation models for open multi-agent systems: a review
Artificial Intelligence Review
Hi-index | 0.00 |
Trust models are mechanisms that predict behavior of potential interaction partners. They have been proposed in several domains and many advances in trust formation have been made recently. The question of comparing trust models, however, is still without a clear answer. Traditionally, authors set up ad hoc experiments and present evaluation results that are difficult to compare - sometimes even interpret - in the context of other trust models. As a solution, the community came up with common evaluation platforms, called trust testbeds. In this paper we expose shortcomings of evaluation models that existing testbeds use; they evaluate trust models by combining them with some ad hoc decision making mechanism and then evaluate the quality of trust-based decisions. They assume that if all trust models use the same decision making mechanism, the mechanism itself becomes irrelevant for the evaluation. We hypothesized that the choice of decision making mechanism is in fact relevant. To test our claim we built a testbed, called Alpha testbed, that can evaluate trust models either with or without decision making mechanism. With it we evaluated five well-known trust models using two different decision making mechanisms. The results confirm our hypothesis; the choice of decision making mechanisms influences the performance of trust models. Based on our findings, we recommend to evaluate trust models independently of the decision making mechanism - and we also provide a method (and a tool) to do so.