Effectiveness of Q-learning as a tool for calibrating agent-based supply network models

Authors:
Y. Zhang;S. Bhattacharyya
Affiliations:
Department of Management Information Systems, College of Business and Management, University of Illinois at Springfield, Springfield, Illinois, USA;Department of Information and Decision Sciences, University of Illinois at Chicago, Chicago, Illinois 60607, USA
Venue:
Enterprise Information Systems
Year:
2007

Citing 8
Cited 5

Electronic markets and electronic hierarchies

Communications of the ACM
Strategic pricebot dynamics

Proceedings of the 1st ACM conference on Electronic commerce
Pricing in Agent Economies Using Multi-Agent Q-Learning

Autonomous Agents and Multi-Agent Systems
Learning Curve: A Simulation-Based Approach to Dynamic Pricing

Electronic Commerce Research
Pricing and Replenishment Strategies in a Distribution System with Competing Retailers

Operations Research
Optimal Policies for a Multi-Echelon Inventory Problem

Management Science
Flood decision support system on agent grid: method and implementation

Enterprise Information Systems
Electronic marketplace definition and classification: literature review and clarifications

Enterprise Information Systems

A multi-agent-based model for a negotiation support system in electronic commerce

Enterprise Information Systems
Architecture, implementation and application of complex event processing in enterprise information systems based on RFID

Information Systems Frontiers
Effects of two national environmental factors on e-commerce functionality adoption: a cross-country case study of a global bank

Enterprise Information Systems
Distributed data mining for e-business

Information Technology and Management
Effects of promotion cost sharing policy with the sales learning curve on supply chain coordination

Computers and Operations Research

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper examines effectiveness of Q-learning as a tool for specifying agent attributes and behaviours in agent-based supply network models. Agent-based modelling (ABM) has been increasingly employed to study supply chain and supply network problems. A challenging task in building agent-based supply network models is to properly specify agent attributes and behaviours. Machine learning techniques, such as Q-learning, can be a useful tool for this purpose. Q-learning is a reinforcement learning technique that has been shown to be an effective adaptation and searching mechanism in distributed settings. In this study, Q-learning is employed by supply network agents to search for 'optimal' values for a parameter in their operating policies simultaneously and independently. Methods are designed to identify the 'optimal' parameter values against which effectiveness of the learning is evaluated. Robustness of the learning's effectiveness is also examined through consideration of different model settings and scenarios. Results show that Q-learning is very effective in finding the 'optimal' parameter values in all model settings and scenarios considered.