An adaptive approach for the exploration-exploitation dilemma for learning agents

Authors:
Lilia Rejeb;Zahia Guessoum;Rym M'Hallah
Affiliations:
MODECO Team, CReSTIC, Reims Cedex2, France;MODECO Team, CReSTIC, Reims Cedex2, France;Dep. of Statistics and Operations Research, Kuwait University, Safat
Venue:
CEEMAS'05 Proceedings of the 4th international Central and Eastern European conference on Multi-Agent Systems and Applications
Year:
2005

Citing 7
Cited 0

Technical Note: \cal Q-Learning

Machine Learning
Exploration of Multi-State Environments: Local Measures and Back-Propagation of Uncertainty

Machine Learning
Introduction to Reinforcement Learning

Introduction to Reinforcement Learning
Exploration Strategies for Model-based Learning in Multi-agent Systems: Exploration Strategies

Autonomous Agents and Multi-Agent Systems
Social Simulation Using a Multi-agent Model Based on Classifier Systems: The Emergence of Vacillating Behaviour in the "El Farol" Bar Problem

IWLCS '01 Revised Papers from the 4th International Workshop on Advances in Learning Classifier Systems
Classifier fitness based on accuracy

Evolutionary Computation
Reinforcement learning: a survey

Journal of Artificial Intelligence Research

Quantified Score

Hi-index	0.01

Visualization

Abstract

Learning agents have to deal with the exploration-exploitation dilemma. The choice between exploration and exploitation is very difficult in dynamic systems; in particular in large scale ones such as economic systems. Recent research shows that there is neither an optimal nor a unique solution for this problem. In this paper, we propose an adaptive approach based on meta-rules to adapt the choice between exploration and exploitation. This new adaptive approach relies on the variations of the performance of the agents. To validate the approach, we apply it to economic systems and compare it to two adaptive methods: one local and one global. Herein, we adapt these two methods, which were originally proposed by Wilson, to economic systems. Moreover, we compare different exploration strategies and focus on their influence on the performance of the agents.