Variational Bayesian approximation of inverse problems using sparse precision matrices
View / Open Files
Publication Date
2022Journal Title
Computer Methods in Applied Mechanics and Engineering
ISSN
0045-7825
Publisher
Elsevier BV
Type
Article
This Version
AM
Metadata
Show full item recordCitation
Povala, J., Kazlauskaite, I., Febrianto, E., Cirak, F., & Girolami, M. (2022). Variational Bayesian approximation of inverse problems using sparse precision matrices. Computer Methods in Applied Mechanics and Engineering https://doi.org/10.1016/j.cma.2022.114712
Abstract
Inverse problems involving partial differential equations are widely used in science and engineering. Although such problems are generally ill-posed, different regularisation approaches have been developed to ameliorate this problem. Among them is the Bayesian formulation, where a prior probability measure is placed on the quantity of interest. The resulting posterior probability measure is usually analytically intractable. The Markov Chain Monte Carlo (MCMC) method has been the go-to method for sampling from those posterior measures. MCMC is computationally infeasible for large-scale problems that arise in engineering practice. Lately, Variational Bayes (VB) has been recognised as a more computationally tractable method for Bayesian inference, approximating a Bayesian posterior distribution with a simpler trial distribution by solving an optimisation problem. In this work, we argue, through an empirical assessment, that VB methods are a flexible and efficient alternative to MCMC for this class of problems. We propose a natural choice of a family of Gaussian trial distributions parametrised by precision matrices, thus taking advantage of the inherent sparsity of the inverse problem encoded in its finite element discretisation. We utilise stochastic optimisation to efficiently estimate the variational objective and assess not only the error in the solution mean but also the ability to quantify the uncertainty of the estimate. We test this on PDEs based on the Poisson equation in 1D and 2D. A Tensorflow implementation is made publicly available on GitHub.
Keywords
stat.AP, stat.AP, stat.CO, 74S05, 74S60, 62-08, 62P30
Sponsorship
Engineering and Physical Sciences Research Council (EP/R034710/1)
Royal Academy of Engineering (RAEng) (RCSRF\1718\6\34)
EPSRC (via University of Warwick) (EP/R034710/1)
EPSRC (EP/P020720/2)
EPSRC (EP/R018413/2)
EPSRC (via Imperial College London) (EP/T000414/1)
Engineering and Physical Sciences Research Council (EP/R004889/1)
EPSRC (via Alan Turing Institute) (EP/T001569/1)
Embargo Lift Date
2023-04-30
Identifiers
External DOI: https://doi.org/10.1016/j.cma.2022.114712
This record's URL: https://www.repository.cam.ac.uk/handle/1810/333820
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Licence URL: https://creativecommons.org/licenses/by-nc-nd/4.0/
Statistics
Total file downloads (since January 2020). For more information on metrics see the
IRUS guide.