Approximate Parameter Learning in Conditional Random Fields: An Empirical Investigation

Authors:
Filip Korč;Wolfgang Förstner
Affiliations:
Department of Photogrammetry, University of Bonn, Bonn, Germany 53115;Department of Photogrammetry, University of Bonn, Bonn, Germany 53115
Venue:
Proceedings of the 30th DAGM symposium on Pattern Recognition
Year:
2008

Citing 9
Cited 3

Parallel and Deterministic Algorithms from MRFs: Surface Reconstruction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast Approximate Energy Minimization via Graph Cuts

IEEE Transactions on Pattern Analysis and Machine Intelligence
Training products of experts by minimizing contrastive divergence

Neural Computation
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Discriminative Random Fields: A Discriminative Framework for Contextual Interaction in Classification

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Discriminative Random Fields

International Journal of Computer Vision
Accelerated training of conditional random fields with stochastic gradient methods

ICML '06 Proceedings of the 23rd international conference on Machine learning
Piecewise pseudolikelihood for efficient training of conditional random fields

Proceedings of the 24th international conference on Machine learning
Exploiting inference for approximate parameter learning in discriminative fields: an empirical study

EMMCVPR'05 Proceedings of the 5th international conference on Energy Minimization Methods in Computer Vision and Pattern Recognition

On parameter learning in CRF-based approaches to object class image segmentation

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Man made structure detection and verification of object recognition in images for the visually impaired

Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
Automated image analysis framework for high-throughput determination of grapevine berry sizes using conditional random fields

Computers and Electronics in Agriculture

Quantified Score

Hi-index	0.00

Visualization

Abstract

We investigate maximum likelihood parameter learning in Conditional Random Fields (CRF) and present an empirical study of pseudo-likelihood (PL) based approximations of the parameter likelihood gradient. We show, as opposed to [1][2], that these parameter learning methods can be improved and evaluate the resulting performance employing different inference techniques. We show that the approximation based on penalized pseudo-likelihood (PPL) in combination with the Maximum A Posteriori (MAP) inference yields results comparable to other state of the art approaches, while providing advantages to formulating parameter learning as a convex optimization problem. Eventually, we demonstrate applicability on the task of detecting man-made structures in natural images.