Active learning of combinatorial features for interactive optimization

  • Authors:
  • Paolo Campigotto;Andrea Passerini;Roberto Battiti

  • Affiliations:
  • DISI - Dipartimento di Ingegneria e Scienza dell'Informazione, Università degli Studi di Trento, Italy;DISI - Dipartimento di Ingegneria e Scienza dell'Informazione, Università degli Studi di Trento, Italy;DISI - Dipartimento di Ingegneria e Scienza dell'Informazione, Università degli Studi di Trento, Italy

  • Venue:
  • LION'05 Proceedings of the 5th international conference on Learning and Intelligent Optimization
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We address the problem of automated discovery of preferred solutions by an interactive optimization procedure. The algorithm iteratively learns a utility function modeling the quality of candidate solutions and uses it to generate novel candidates for the following refinement. We focus on combinatorial utility functions made of weighted conjunctions of Boolean variables. The learning stage exploits the sparsity-inducing property of 1-norm regularization to learn a combinatorial function from the power set of all possible conjunctions up to a certain degree. The optimization stage uses a stochastic local search method to solve a weighted MAX-SAT problem. We show how the proposed approach generalizes to a large class of optimization problems dealing with satisfiability modulo theories. Experimental results demonstrate the effectiveness of the approach in focusing towards the optimal solution and its ability to recover from suboptimal initial choices.