Overfitting or poor learning: a critique of current financial applications of GP

  • Authors:
  • Shu-Heng Chen;Tzu-Wen Kuo

  • Affiliations:
  • AI-ECON Research Center, Department of Economics, National Chengchi University, Taipei, Taiwan;AI-ECON Research Center, Department of Economics, National Chengchi University, Taipei, Taiwan

  • Venue:
  • EuroGP'03 Proceedings of the 6th European conference on Genetic programming
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Motivated by a measure of predictability, this paper uses the extracted signal ratio as a measure of the degree of overfitting. With this measure, we examine the performance of one type of overfitting-avoidance design frequently used in financial applications of GP. Based on the simulation results run with the software Simple GP, we find that this design is not effective in avoiding overfitting. Furthermore, within the range of search intensity typically considered by these applications, we find that underfitting, instead of overfitting, is the more prevalent problem. This problem becomes more serious when the data is generated by a process that has a high degree of algorithmic complexity. This paper, therefore, casts doubt on the conclusions made by those early applications regarding the poor performance of GP, and recommends that changes be made to ensure progress.