Integer linear programming inference for conditional random fields

Authors:
Dan Roth;Wen-tau Yih
Affiliations:
University of Illinois at Urbana-Champaign, Urbana, IL;University of Illinois at Urbana-Champaign, Urbana, IL
Venue:
ICML '05 Proceedings of the 22nd international conference on Machine learning
Year:
2005

Citing 8
Cited 40

Large Margin Classification Using the Perceptron Algorithm

Machine Learning - The Eleventh Annual Conference on computational Learning Theory
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Shallow parsing with conditional random fields

NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Introduction to the CoNLL-2000 shared task: chunking

ConLL '00 Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning - Volume 7
Discriminative training methods for hidden Markov models: theory and experiments with perceptron algorithms

EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10
Semantic role labeling via integer linear programming inference

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Interactive information extraction with constrained conditional random fields

AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
Learning and inference over constrained output

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence

A fast finite-state relaxation method for enforcing global constraints on sequence decoding

HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Training structural SVMs when exact inference is intractable

Proceedings of the 25th international conference on Machine learning
The importance of syntactic parsing and inference in semantic role labeling

Computational Linguistics
Relaxation Labeling for Selecting and Exploiting Efficiently Non-local Dependencies in Sequence Labeling

PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
Academic conference homepage understanding using constrained hierarchical conditional random fields

Proceedings of the 17th ACM conference on Information and knowledge management
Polyhedral outer approximations with application to natural language parsing

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Sparse higher order conditional random fields for improved sequence labeling

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Multi-lingual dependency parsing with incremental integer linear programming

CoNLL-X '06 Proceedings of the Tenth Conference on Computational Natural Language Learning
Grammatical role labeling with integer linear programming

EACL '06 Proceedings of the Eleventh Conference of the European Chapter of the Association for Computational Linguistics: Posters & Demonstrations
Learning and inference with constraints

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
Combination strategies for semantic role labeling

Journal of Artificial Intelligence Research
Global inference for sentence compression an integer linear programming approach

Journal of Artificial Intelligence Research
A ranking approach to stress prediction for letter-to-phoneme conversion

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Concise integer linear programming formulations for dependency parsing

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
First-order mixed integer linear programming

UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Inference with constrained hidden markov models in prism

Theory and Practice of Logic Programming
Global learning of focused entailment graphs

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
On dual decomposition and linear programming relaxations for natural language processing

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Assessing phrase-based translation models with oracle decoding

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Ranking under temporal constraints

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Semantic annotation of web objects using constrained conditional random fields

WAIM'10 Proceedings of the 11th international conference on Web-age information management
Punctuation: making a point in unsupervised dependency parsing

CoNLL '11 Proceedings of the Fifteenth Conference on Computational Natural Language Learning
Database foundations for scalable RDF processing

RW'11 Proceedings of the 7th international conference on Reasoning web: semantic technologies for the web of data
Probabilistic-logical web data integration

RW'11 Proceedings of the 7th international conference on Reasoning web: semantic technologies for the web of data
Conditional graphical models for protein structure prediction

Conditional graphical models for protein structure prediction
Recognizing interleaved and concurrent activities using qualitative and quantitative temporal relationships

Pervasive and Mobile Computing
Efficient inference in large conditional random fields

ECML'06 Proceedings of the 17th European conference on Machine Learning
An inference model for semantic entailment in natural language

MLCW'05 Proceedings of the First international conference on Machine Learning Challenges: evaluating Predictive Uncertainty Visual Object Classification, and Recognizing Textual Entailment
A joint model for extended semantic role labeling

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Identifying relations for open information extraction

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Integer linear programming for dutch sentence compression

CICLing'10 Proceedings of the 11th international conference on Computational Linguistics and Intelligent Text Processing
Guaranteeing secure transmission in time critical networks through dual sense multiple control channel protocol

Proceedings of the 1st International Conference on Wireless Technologies for Humanitarian Relief
Integer linear programming for Constrained Multi-Aspect Committee Review Assignment

Information Processing and Management: an International Journal
Automatic event extraction with structured preference modeling

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Exploring deterministic constraints: from a constrained English POS tagger to an efficient ILP solution to Chinese word segmentation

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Improved parsing and POS tagging using inter-sentence consistency constraints

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
A tutorial on dual decomposition and lagrangian relaxation for inference in natural language processing

Journal of Artificial Intelligence Research
Dependency-based semantic role labeling using sequence labeling with a structural SVM

Pattern Recognition Letters
Oracle decoding as a new way to analyze phrase-based machine translation

Machine Translation
CRF framework for supervised preference aggregation

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management

Quantified Score

Hi-index	0.00

Visualization

Abstract

Inference in Conditional Random Fields and Hidden Markov Models is done using the Viterbi algorithm, an efficient dynamic programming algorithm. In many cases, general (non-local and non-sequential) constraints may exist over the output sequence, but cannot be incorporated and exploited in a natural way by this inference procedure. This paper proposes a novel inference procedure based on integer linear programming (ILP) and extends CRF models to naturally and efficiently support general constraint structures. For sequential constraints, this procedure reduces to simple linear programming as the inference process. Experimental evidence is supplied in the context of an important NLP problem, semantic role labeling.