On fairness and learning agents in a bargaining model with uncertainty

  • Authors:
  • Norberto Eiji Nawa;Katsunori Shimohara;Osamu Katai

  • Affiliations:
  • ATR Human Information Science Laboratories, 2-2-2 Hikari-dai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan and Graduate School of Informatics, Kyoto University, Yoshida-honmachi, Sakyo-ku, Kyoto 6 ...;ATR Human Information Science Laboratories, 2-2-2 Hikari-dai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan and Graduate School of Informatics, Kyoto University, Yoshida-honmachi, Sakyo-ku, Kyoto 6 ...;Graduate School of Informatics, Kyoto University, Yoshida-honmachi, Sakyo-ku, Kyoto 606-8501, Japan

  • Venue:
  • Cognitive Systems Research
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

The emergence of fair divisions in a repeated bargaining game is investigated in a computational model. Individuals of human societies often appeal to some norm of fairness in situations where an agreement over the division of a surplus is required. The employed framework consists of players alternating offers that describe possible ways to share a certain commodity. The players are allowed a limited number of offers to reach an agreement; if they fail to agree, the player who made the first offer, the lucky player, wins the whole lot at stake. Uncertainty is introduced in the process by randomly choosing the lucky player at the beginning of each iteration. In the experiments, the players acquired strategies by employing a variant of Q-learning, a reinforcement learning algorithm. Experiments were performed with different configurations of utility functions on the players' preferences in taking actions in risky situations. Analysis of the results shows that the game theoretical model of a single shot of the bargaining game used in the experiments closely matches the outcomes obtained in the simulated framework, despite the differences in the quality of the players, who are assumed to be fully rational in the theoretical model. Learning agents that are timid toward risky situations manage to acquire strategies that lead to fair outcomes when playing against each other, but find themselves in a disadvantageous position when confronting bolder types.