BayesFlow: learning complex stochastic models with invertible neural networks

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit likelihood function is not available. With this work, we propose...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Radev, Stefan (VerfasserIn) , Mertens, Ulf K. (VerfasserIn) , Voß, Andreas (VerfasserIn) , Ardizzone, Lynton (VerfasserIn) , Köthe, Ullrich (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 2022
In: IEEE transactions on neural networks and learning systems
Year: 2022, Jahrgang: 33, Heft: 4, Pages: 1452-1466
ISSN:2162-2388
DOI:10.1109/TNNLS.2020.3042395
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1109/TNNLS.2020.3042395
Volltext
Verfasserangaben:Stefan T. Radev, Ulf K. Mertens, Andreas Voss, Lynton Ardizzone, and Ullrich Köthe, Member, IEEE
Beschreibung
Zusammenfassung:Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit likelihood function is not available. With this work, we propose a novel method for globally amortized Bayesian inference based on invertible neural networks that we call BayesFlow. The method uses simulations to learn a global estimator for the probabilistic mapping from observed data to underlying model parameters. A neural network pretrained in this way can then, without additional training or optimization, infer full posteriors on arbitrarily many real data sets involving the same model family. In addition, our method incorporates a summary network trained to embed the observed data into maximally informative summary statistics. Learning summary statistics from data makes the method applicable to modeling scenarios where standard inference techniques with handcrafted summary statistics fail. We demonstrate the utility of BayesFlow on challenging intractable models from population dynamics, epidemiology, cognitive science, and ecology. We argue that BayesFlow provides a general framework for building amortized Bayesian parameter estimation machines for any forward model from which data can be simulated.
Beschreibung:Date of publication: 18 December 2020
Gesehen am 31.05.2022
Beschreibung:Online Resource
ISSN:2162-2388
DOI:10.1109/TNNLS.2020.3042395