Entropy Message Passing

Authors:
V. M. Ilić;M. S. Stanković;B. T. Todorović
Affiliations:
Dept. of Inf., Univ. of Nis, Nis, Serbia;-;-
Venue:
IEEE Transactions on Information Theory
Year:
2011

Citing 0
Cited 1

Gradient computation in linear-chain conditional random fields using the entropy message passing algorithm

Pattern Recognition Letters

Quantified Score

Hi-index	754.84

Visualization

Abstract

The paper proposes a new message passing algorithm for cycle-free factor graphs. The proposed "entropy message passing" (EMP) algorithm may be viewed as sum-product message passing over the entropy semiring, which has previously appeared in automata theory. The primary use of EMP is to compute the entropy of a model. However, EMP can also be used to compute expressions that appear in expectation maximization and in gradient-descent algorithms.