Repository logo
 

Self-Guided Belief Propagation - A Homotopy Continuation Method.

Accepted version
Peer-reviewed

Type

Article

Change log

Authors

Knoll, Christian 
Pernkopf, Franz 

Abstract

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models. In this work, we enhance BP and propose self-guided belief propagation (SBP) that incorporates the pairwise potentials only gradually. This homotopy continuation method converges to a unique solution and increases the accuracy without increasing the computational burden. We provide a formal analysis to demonstrate that SBP finds the global optimum of the Bethe approximation for attractive models where all variables favor the same state. Moreover, we apply SBP to various graphs with random potentials and empirically show that: (i) SBP is superior in terms of accuracy whenever BP converges, and (ii) SBP obtains a unique, stable, and accurate solution whenever BP does not converge.

Description

Keywords

Computational modeling, Belief propagation, Probabilistic logic, Convergence, Graphical models, Couplings, Random variables, belief propagation, probabilistic inference, sum-product algorithm, partition function, inference algorithms

Journal Title

IEEE Trans Pattern Anal Mach Intell

Conference Name

Journal ISSN

0162-8828
1939-3539

Volume Title

Publisher

Institute of Electrical and Electronics Engineers (IEEE)
Sponsorship
Leverhulme Trust (RC-2015-067)
EPSRC (EP/V025279/1)
The Alan Turing Institute Leverhulme CFI