Substructural Surrogates for Learning Decomposable Classification Problems

  • Authors:
  • Albert Orriols-Puig;Kumara Sastry;David E. Goldberg;Ester Bernadó-Mansilla

  • Affiliations:
  • Grup de Recerca en Sistemes Intel.ligents, Enginyeria i Arquitectura La Salle, Universitat Ramon Llull, Barcelona, Spain 08022 and Illinois Genetic Algorithms Laboratory, Department of Industrial ...;Illinois Genetic Algorithms Laboratory, Department of Industrial and Enterprise Systems Engineering, University of Illinois, Urbana-Champaign,;Illinois Genetic Algorithms Laboratory, Department of Industrial and Enterprise Systems Engineering, University of Illinois, Urbana-Champaign,;Grup de Recerca en Sistemes Intel.ligents, Enginyeria i Arquitectura La Salle, Universitat Ramon Llull, Barcelona, Spain 08022

  • Venue:
  • Learning Classifier Systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a learning methodology based on a substructural classification model to solve decomposable classification problems. The proposed method consists of three important components: (1) a structural model, which represents salient interactions between attributes for a given data, (2) a surrogate model, which provides a functional approximation of the output as a function of attributes, and (3) a classification model, which predicts the class for new inputs. The structural model is used to infer the functional form of the surrogate. Its coefficients are estimated using linear regression methods. The classification model uses a maximally-accurate, least-complex surrogate to predict the output for given inputs. The structural model that yields an optimal classification model is searched using an iterative greedy search heuristic. Results show that the proposed method successfully detects the interacting variables in hierarchical problems, groups them in linkages groups, and builds maximally accurate classification models. The initial results on non-trivial hierarchical test problems indicate that the proposed method holds promise and also shed light on several improvements to enhance the capabilities of the proposed method.