Repository logo
 

Clamping improves TRW and mean field approximations

Published version
Peer-reviewed

Repository DOI


Change log

Authors

Domke, J 

Abstract

We examine the effect of clamping variables for approximate inference in undirected graphical models with pairwise relationships and discrete variables. For any number of variable labels, we demonstrate that clamping and summing approximate sub-partition functions can lead only to a decrease in the partition function estimate for TRW, and an increase for the naive mean field method, in each case guaranteeing an improvement in the approximation and bound. We next focus on binary variables, add the Bethe approximation to consideration and examine ways to choose good variables to clamp, introducing new methods. We show the importance of identifying highly frustrated cycles, and of checking the singleton entropy of a variable. We explore the value of our methods by empirical analysis and draw lessons to guide practitioners.

Description

Keywords

cs.LG, cs.LG, cs.AI, stat.ML

Journal Title

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016

Conference Name

Journal ISSN

Volume Title

Publisher

MIT Press

Publisher DOI

Publisher URL

Sponsorship
NICTA is funded by the Australian Government through the Department of Communications and the Australian Research Council through the ICT Centre of Excellence Program.