Publication Type
Journal Article
Version
publishedVersion
Publication Date
5-2023
Abstract
Power posteriors have become popular in estimating the marginal likelihood of a Bayesian model. A power posterior is referred to as the posterior distribution that is proportional to the likelihood raised to a power b∈[0,1]. Important power-posterior-based algorithms include thermodynamic integration (TI) of Friel and Pettitt (2008) and steppingstone sampling (SS) of Xie et al. (2011). In this paper, it is shown that the Bernstein–von Mises (BvM) theorem holds for power posteriors under regularity conditions. Due to the BvM theorem, power posteriors, when adjusted by the square root of the auxiliary constant, have the same limit distribution as the original posterior distribution, facilitating the implementation of the modified TI and SS methods via importance sampling. Unlike the TI and SS methods that require repeated sampling from the power posteriors, the modified methods only need the original posterior output and hence, are computationally more efficient. Moreover, they completely avoid the coding efforts associated with sampling from the power posteriors. Primitive conditions, under which the TI and modified TI algorithms can produce consistent estimators of the marginal likelihood, are provided. The numerical efficiency of the proposed methods is illustrated using two models.
Keywords
Bayes factor, importance sampling, marginal likelihood, Markov chain Monte Carlo, model choice, power posteriors
Discipline
Econometrics
Research Areas
Econometrics
Publication
Journal of Econometrics
Volume
234
Issue
1
First Page
28
Last Page
52
ISSN
0304-4076
Identifier
10.1016/j.jeconom.2021.11.009
Publisher
Elsevier: 24 months
Citation
LI, Yong; WANG, Nianling; and Jun YU.
Improved marginal likelihood estimation via power posteriors and importance sampling. (2023). Journal of Econometrics. 234, (1), 28-52.
Available at: https://ink.library.smu.edu.sg/soe_research/2552
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://ink.library.smu.edu.sg/soe_research/2552/