A deep learning method for comparing Bayesian hierarchical models

Bayesian model comparison (BMC) offers a principled approach to assessing the relative merits of competing computational models and propagating uncertainty into model selection decisions. However, BMC is often intractable for the popular class of hierarchical models due to their high-dimensional nes...

Full description

Saved in:
Bibliographic Details
Main Authors: Elsemüller, Lasse (Author) , Schnürch, Martin (Author) , Bürkner, Paul-Christian (Author) , Radev, Stefan (Author)
Format: Article (Journal)
Language:English
Published: 2024
In: Psychological methods
Year: 2024, Pages: ?
ISSN:1939-1463
DOI:10.1037/met0000645
Online Access:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1037/met0000645
Get full text
Author Notes:Lasse Elsemüller, Martin Schnuerch, Paul-Christian Bürkner, Stefan T. Radev
Description
Summary:Bayesian model comparison (BMC) offers a principled approach to assessing the relative merits of competing computational models and propagating uncertainty into model selection decisions. However, BMC is often intractable for the popular class of hierarchical models due to their high-dimensional nested parameter structure. To address this intractability, we propose a deep learning method for performing BMC on any set of hierarchical models which can be instantiated as probabilistic programs. Since our method enables amortized inference, it allows efficient re-estimation of posterior model probabilities and fast performance validation prior to any real-data application. In a series of extensive validation studies, we benchmark the performance of our method against the state-of-the-art bridge sampling method and demonstrate excellent amortized inference across all BMC settings. We then showcase our method by comparing four hierarchical evidence accumulation models that have previously been deemed intractable for BMC due to partly implicit likelihoods. Additionally, we demonstrate how transfer learning can be leveraged to enhance training efficiency. We provide reproducible code for all analyses and an open-source implementation of our method. (PsycInfo Database Record (c) 2024 APA, all rights reserved)
Item Description:Gesehen am 30.09.2024
Physical Description:Online Resource
ISSN:1939-1463
DOI:10.1037/met0000645