A specification of the Agent Reputation and Trust (ART) testbed: experimentation and competition for trust in agent societies

  • Authors:

  • Karen K. Fullam;Tomas B. Klos;Guillaume Muller;Jordi Sabater;Andreas Schlosser;Zvi Topol;K. Suzanne Barber;Jeffrey S. Rosenschein;Laurent Vercouter;Marco Voss

  • Affiliations:

  • University of Texas at Austin;Center for Mathematics and Computer Science (CWI), Amsterdam, The Netherlands;SMA/G21---École Nationale Supérieure des Mines, Saint-Étienne, France;National Research Council (CNR), Rome, Italy;Darmstadt University of Technology, Darmstadt, Germany;Hebrew University, Jerusalem, Israel;University of Texas at Austin;Hebrew University, Jerusalem, Israel;SMA/G21---École Nationale Supérieure des Mines, Saint-Étienne, France;Darmstadt University of Technology, Darmstadt, Germany

  • Venue:
  • Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

A diverse collection of trust-modeling algorithms for multi-agent systems has been developed in recent years, resulting in significant breadth-wise growth without unified direction or benchmarks. Based on enthusiastic response from the agent trust community, the Agent Reputation and Trust (ART) Testbed initiative has been launched, charged with the task of establishing a testbed for agent trust- and reputation-related technologies. This testbed serves in two roles: (1) as a competition forum in which researchers can compare their technologies against objective metrics, and (2) as a suite of tools with flexible parameters, allowing researchers to perform customizable, easily-repeatable experiments. This paper first enumerates trust research objectives to be addressed in the testbed and desirable testbed characteristics, then presents a competition testbed specification that is justified according to these requirements. In the testbed's artwork appraisal domain, agents, who valuate paintings for clients, may gather opinions from other agents to produce accurate appraisals. The testbed's implementation architecture is discussed briefly, as well.