Application of referenced thermodynamic integration to Bayesian model selection
File(s)journal.pone.0289889.pdf (1.24 MB)
Published version
Author(s)
Hawryluk, Iwona
Mishra, swapnil
Flaxman, seth
Bhatt, samir
Mellan, thomas
Type
Journal Article
Abstract
Evaluating normalising constants is important across a range of topics in statistical
learning, notably Bayesian model selection. However, in many realistic problems this
involves the integration of analytically intractable, high-dimensional distributions, and
therefore requires the use of stochastic methods such as thermodynamic integration
(TI). In this paper we apply a simple but under-appreciated variation of the TI method,
here referred to as referenced TI, which computes a single model’s normalising constant
in an efficient way by using a judiciously chosen reference density. The advantages of
the approach and theoretical considerations are set out, along with pedagogical 1 and
2D examples. The approach is shown to be useful in practice when applied to a real
problem — to perform model selection for a semi-mechanistic hierarchical Bayesian
model of COVID-19 transmission in South Korea involving the integration of a 200D
density.
learning, notably Bayesian model selection. However, in many realistic problems this
involves the integration of analytically intractable, high-dimensional distributions, and
therefore requires the use of stochastic methods such as thermodynamic integration
(TI). In this paper we apply a simple but under-appreciated variation of the TI method,
here referred to as referenced TI, which computes a single model’s normalising constant
in an efficient way by using a judiciously chosen reference density. The advantages of
the approach and theoretical considerations are set out, along with pedagogical 1 and
2D examples. The approach is shown to be useful in practice when applied to a real
problem — to perform model selection for a semi-mechanistic hierarchical Bayesian
model of COVID-19 transmission in South Korea involving the integration of a 200D
density.
Date Issued
2023-08-14
Date Acceptance
2023-07-27
Citation
PLoS One, 2023, 18 (8), pp.1-16
ISSN
1932-6203
Publisher
Public Library of Science (PLoS)
Start Page
1
End Page
16
Journal / Book Title
PLoS One
Volume
18
Issue
8
Copyright Statement
Copyright: © 2023 Hawryluk et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
License URL
Identifier
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0289889
Publication Status
Published
Article Number
e0289889
Date Publish Online
2023-08-14