Validating and Calibrating Agent-Based Models: A Case Study

  • Authors:
  • Carlo Bianchi;Pasquale Cirillo;Mauro Gallegati;Pietro A. Vagliasindi

  • Affiliations:
  • Dipartimento di Scienze Economiche, Università di Pisa, Pisa, Italy;IMQ, Università Bocconi, Milan, Italy;DEA/SIEC, Università Politecnica delle Marche, Ancona, Italy;Dipartimento di Diritto, Economia e Finanza Internazionale, Università di Parma, Parma, Italy

  • Venue:
  • Computational Economics
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we deal with some validation and calibration experiments on a modified version of the Complex Adaptive Trivial System (CATS) model proposed in Gallegati et al. (2005 Journal of Economic Behavior and Organization, 56, 489---512). The CATS model has been extensively used to replicate a large number of scaling types stylized facts with a remarkable degree of precision. For such purposes, the simulation of the model has been performed entering ad hoc parameter values and using the same initial set up for all the agents involved in the experiments. Nowadays alternative robust and reliable validation techniques for determining whether the simulation model is an acceptable representation of the real system are available. Moreover many distributional and goodness-of-fit tests have been developed while several graphical tools have been proposed to give the researcher a quick comprehension of actual and simulated data. This paper discusses some validation experiments performed with the modified CATS model. In particular starting from a sample of Italian firms included in the CEBI database, we perform several ex-post validation experiments over the simulation period 1982---2000. In the experiments, the model parameters have been estimated using actual data and the initial set up consists of a sample of agents in 1982. The CATS model is then simulated over the period 1982---2000. Using alternative validation techniques, the simulations' results are ex-post validated with respect to the actual data. The results are promising in that they show the good capabilities of the CATS model in reproducing the observed reality. Finally we have performed a first calibration experiment via indirect inference, in order to ameliorate our estimates. Even in this case, the results are interesting.