Learning and inference with constraints

  • Authors:
  • Ming-Wei Chang;Lev Ratinov;Nicholas Rizzolo;Dan Roth

  • Affiliations:
  • Computer Science Department, University of Illinois at Urbana-Champaign;Computer Science Department, University of Illinois at Urbana-Champaign;Computer Science Department, University of Illinois at Urbana-Champaign;Computer Science Department, University of Illinois at Urbana-Champaign

  • Venue:
  • AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Probabilistic modeling has been a dominant approach in Machine Learning research. As the field evolves, thc problems of interest become increasingly challenging and complex. Making complex decisions in real world problems often involves assigning values to sets of interdependent variables where the expressive dependency structure can influence, or even dictate, what assignments are possible. However, incorporating nonlocal depcndencies in a probabilistic model can lead to intractable training and inference. This paper presents Constraints Conditional Models (CCMs), a framework that augments probabilistic models with declarative constraints as a way to support decisions in an expressive output space while maintaining modularity and tractability of training. We further show that declarative constraints can be used to take advantage of unlabeled data when training the probabilistic model.