Empirical Comparison of Various Reinforcement Learning Strategies for Sequential Targeted Marketing

  • Authors:
  • Naoki Abe;Edwin Pednault;Haixun Wang;Bianca Zadrozny;Wei Fan;Chid Apte

  • Affiliations:
  • -;-;-;-;-;-

  • Venue:
  • ICDM '02 Proceedings of the 2002 IEEE International Conference on Data Mining
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We empirically evaluate the performance of various re-inforcementlearning methods in applications to sequentialtargeted marketing. In particular, we propose and evaluatea progression of reinforcement learning methods, rangingfrom the "direct" or "batch" methods to "indirect" or"simulation based" methods, and those that we call "semi-direct"methods that fall between them. We conduct a num-berof controlled experiments to evaluate the performanceof these competing methods. Our results indicate that whilethe indirect methods can perform better in a situation inwhich nearly perfect modeling is possible, under the morerealistic situations in which the system's modeling parametershave restricted attention, the indirect methods' performancetend to degrade. We also show that semi-directmethods are effective in reducing the amount of computationnecessary to attain a given level of performance, andoften result in more profitable policies.