Performance evaluation methods for the trading agent competition

Authors:
Brett Borghetti;Eric Sodomka
Affiliations:
Dept of Computer Science and Engineering, University of Minnesota, Minneapolis, MN;Dept of Computer Science and Engineering, University of Minnesota, Minneapolis, MN
Venue:
AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Year:
2006

Citing 1
Cited 1

Bidding for customer orders in TAC SCM

AAMAS'04 Proceedings of the 6th AAMAS international conference on Agent-Mediated Electronic Commerce: theories for and Engineering of Distributed Mechanisms and Systems

Efficient statistical methods for evaluating trading agent performance

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a novel method to characterize the performance of autonomous agents in the Trading Agent Competition for Supply Chain Management (TAC-SCM). We create benchmarking tools that manipulate market environments to control the conditions and provide guidelines to test trading agents. Using these tools, we show how developers can inspect their agents and unveil behaviors that might otherwise have gone undiscovered.