Learning with configurable operators and RL-based heuristics

  • Authors:
  • Fernando Martínez-Plumed;Cèsar Ferri;José Hernández-Orallo;María José Ramírez-Quintana

  • Affiliations:
  • DSIC, Universitat Politècnica de València, València, Spain;DSIC, Universitat Politècnica de València, València, Spain;DSIC, Universitat Politècnica de València, València, Spain;DSIC, Universitat Politècnica de València, València, Spain

  • Venue:
  • NFMCP'12 Proceedings of the First international conference on New Frontiers in Mining Complex Patterns
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we push forward the idea of machine learning systems for which the operators can be modified and finetuned for each problem. This allows us to propose a learning paradigm where users can write (or adapt) their operators, according to the problem, data representation and the way the information should be navigated. To achieve this goal, data instances, background knowledge, rules, programs and operators are all written in the same functional language, Erlang. Since changing operators affect how the search space needs to be explored, heuristics are learnt as a result of a decision process based on reinforcement learning where each action is defined as a choice of operator and rule. As a result, the architecture can be seen as a …system for writing machine learning systems' or to explore new operators.