Anytime parallel tempering
Singh, Sumeetpal S.
Murray, Lawrence M.
Statistics and Computing
MetadataShow full item record
Marie d’Avigneau, A., Singh, S. S., & Murray, L. M. (2021). Anytime parallel tempering. Statistics and Computing, 31 (6) https://doi.org/10.1007/s11222-021-10048-0
Abstract: Developing efficient MCMC algorithms is indispensable in Bayesian inference. In parallel tempering, multiple interacting MCMC chains run to more efficiently explore the state space and improve performance. The multiple chains advance independently through local moves, and the performance enhancement steps are exchange moves, where the chains pause to exchange their current sample amongst each other. To accelerate the independent local moves, they may be performed simultaneously on multiple processors. Another problem is then encountered: depending on the MCMC implementation and inference problem, local moves can take a varying and random amount of time to complete. There may also be infrastructure-induced variations, such as competing jobs on the same processors, which arises in cloud computing. Before exchanges can occur, all chains must complete the local moves they are engaged in to avoid introducing a potentially substantial bias (Proposition 1). To solve this issue of randomly varying local move completion times in multi-processor parallel tempering, we adopt the Anytime Monte Carlo framework of (Murray, L. M., Singh, S., Jacob, P. E., and Lee, A.: Anytime Monte Carlo. arXiv preprintarXiv:1612.03319, (2016): we impose real-time deadlines on the parallel local moves and perform exchanges at these deadlines without any processor idling. We show our methodology for exchanges at real-time deadlines does not introduce a bias and leads to significant performance enhancements over the naïve approach of idling until every processor’s local moves complete. The methodology is then applied in an ABC setting, where an Anytime ABC parallel tempering algorithm is derived for the difficult task of estimating the parameters of a Lotka–Volterra predator-prey model, and similar efficiency enhancements are observed.
Article, Bayesian inference, Markov chain Monte Carlo (MCMC ), Parallel tempering, Anytime Monte Carlo, Approximate Bayesian computation (ABC ), Likelihood-free inference
Engineering and Physical Sciences Research Council (10392331)
External DOI: https://doi.org/10.1007/s11222-021-10048-0
This record's URL: https://www.repository.cam.ac.uk/handle/1810/330780
Recommended or similar items
The current recommendation prototype on the Apollo Repository will be turned off on 03 February 2023. Although the pilot has been fruitful for both parties, the service provider IKVA is focusing on horizon scanning products and so the recommender service can no longer be supported. We recognise the importance of recommender services in supporting research discovery and are evaluating offerings from other service providers. If you would like to offer feedback on this decision please contact us on: firstname.lastname@example.org