Bayesian context trees: Modelling and exact inference for discrete time series
Publication Date
2022Journal Title
Journal of the Royal Statistical Society. Series B: Statistical Methodology
ISSN
1369-7412
Publisher
Oxford University Press (OUP)
Language
en
Type
Article
This Version
AO
VoR
Metadata
Show full item recordCitation
Kontoyiannis, I., Mertzanis, L., Panotopoulou, A., Papageorgiou, I., & Skoularidou, M. (2022). Bayesian context trees: Modelling and exact inference for discrete time series. Journal of the Royal Statistical Society. Series B: Statistical Methodology https://doi.org/10.1111/rssb.12511
Abstract
We develop a new Bayesian modelling framework for the class of higher-order,
variable-memory Markov chains, and introduce an associated collection of
methodological tools for exact inference with discrete time series. We show
that a version of the context tree weighting algorithm can compute the prior
predictive likelihood exactly (averaged over both models and parameters), and
two related algorithms are introduced, which identify the a posteriori most
likely models and compute their exact posterior probabilities. All three
algorithms are deterministic and have linear-time complexity. A family of
variable-dimension Markov chain Monte Carlo samplers is also provided,
facilitating further exploration of the posterior. The performance of the
proposed methods in model selection, Markov order estimation and prediction is
illustrated through simulation experiments and real-world applications with
data from finance, genetics, neuroscience, and animal communication. The
associated algorithms are implemented in the R package BCT.
Keywords
ORIGINAL ARTICLE, ORIGINAL ARTICLES, Bayes factors, Bayesian context tree, context tree weighting, discrete time series, exact Bayesian inference, Markov chain Monte Carlo, Markov order estimation, model selection, prediction
Identifiers
rssb12511
External DOI: https://doi.org/10.1111/rssb.12511
This record's URL: https://www.repository.cam.ac.uk/handle/1810/336305
Rights
Licence:
http://creativecommons.org/licenses/by-nc-nd/4.0/
Statistics
Total file downloads (since January 2020). For more information on metrics see the
IRUS guide.