Bridging simulations and observations: new insights into galaxy formation simulations via out-of-distribution detection and Bayesian model comparison : evaluating galaxy formation simulations under limited computing budgets and sparse dataset sizes
Context: Cosmological simulations are a powerful tool for advancing our understanding of galaxy formation. A question that naturally arises in light of high-quality observational data is the closeness of the models to reality. Because of the high-dimensionality of the problem, many previous studies...
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
04 September 2025
|
| In: |
Astronomy and astrophysics
Year: 2025, Jahrgang: 701, Pages: 1-18 |
| ISSN: | 1432-0746 |
| DOI: | 10.1051/0004-6361/202453399 |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1051/0004-6361/202453399 Verlag, kostenfrei, Volltext: https://www.aanda.org/articles/aa/abs/2025/09/aa53399-24/aa53399-24.html 
|
| Verfasserangaben: | Lingyi Zhou, Stefan T. Radev, William H. Oliver, Aura Obreja, Zehao Jin, and Tobias Buck |
MARC
| LEADER | 00000naa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 195063308X | ||
| 003 | DE-627 | ||
| 005 | 20260129173034.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 260129s2025 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1051/0004-6361/202453399 |2 doi | |
| 035 | |a (DE-627)195063308X | ||
| 035 | |a (DE-599)KXP195063308X | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 29 |2 sdnb | ||
| 100 | 1 | |a Zhou, Lingyi |e VerfasserIn |0 (DE-588)1388347032 |0 (DE-627)1950633195 |4 aut | |
| 245 | 1 | 0 | |a Bridging simulations and observations |b new insights into galaxy formation simulations via out-of-distribution detection and Bayesian model comparison : evaluating galaxy formation simulations under limited computing budgets and sparse dataset sizes |c Lingyi Zhou, Stefan T. Radev, William H. Oliver, Aura Obreja, Zehao Jin, and Tobias Buck |
| 264 | 1 | |c 04 September 2025 | |
| 300 | |b Illustrationen | ||
| 300 | |a 18 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 29.01.2025 | ||
| 520 | |a Context: Cosmological simulations are a powerful tool for advancing our understanding of galaxy formation. A question that naturally arises in light of high-quality observational data is the closeness of the models to reality. Because of the high-dimensionality of the problem, many previous studies evaluated galaxy simulations using simplified summary statistics. Aims: We combine a simulation-based Bayesian model comparison with a novel mis-specification detection technique to compare galaxy images of six hydrodynamical models from the NIHAO and IllustrisTNG simulations against observations from SDSS. Methods: Since cosmological simulations are computationally costly, we first trained a k-sparse variational autoencoder on the abundant dataset of SDSS images. The variational autoencoder learned to extract informative latent embeddings and delineated the typical set of real images. To reveal simulation gaps, we performed out-of-distribution detection based on the logit functions of classifiers trained on the embeddings of simulated images. Finally, we performed an amortized Bayesian model comparison using a probabilistic classification to identify the relatively best-performing model along with partial explanations through SHapley Additive exPlanations values (SHAP). Results: We find that all six models are mis-specified compared to SDSS observations and can only explain part of reality. The relatively best-performing model comes from the standard NIHAO simulations without active galactic nucleus physics. Based on our inspection of the SHAP-values, we find that the main difference between NIHAO and IllustrisTNG is given by color and morphology. NIHAO is redder and clumpier than IllustrisTNG. Conclusions: By using explainable AI methods such as SHAP values in combination with innovative methods from a simulation-based Bayesian model comparison and new mis-specification detection techniques, we were able to quantitatively compare costly hydrodynamical simulations with real observations and gain physical intuition about the quality of the simulation models. Hence, our new methods help to explain which physical aspects of a particular simulation cause the simulation to match real observations better or worse. This unique feature helps us to inform simulators to improve their simulation model. | ||
| 700 | 1 | |a Radev, Stefan T. |e VerfasserIn |4 aut | |
| 700 | 1 | |a Oliver, William H. |e VerfasserIn |0 (DE-588)1354621018 |0 (DE-627)1915765161 |4 aut | |
| 700 | 1 | |a Obreja, Aura |e VerfasserIn |0 (DE-588)1333330405 |0 (DE-627)1891428454 |4 aut | |
| 700 | 1 | |a Jin, Zehao |e VerfasserIn |4 aut | |
| 700 | 1 | |a Buck, Tobias |e VerfasserIn |0 (DE-588)1125036737 |0 (DE-627)879362006 |0 (DE-576)483288233 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Astronomy and astrophysics |d Les Ulis : EDP Sciences, 1969 |g 701(2025) vom: Sept., Artikel-ID A44, Seite 1-18 |h Online-Ressource |w (DE-627)253390222 |w (DE-600)1458466-9 |w (DE-576)072283351 |x 1432-0746 |7 nnas |a Bridging simulations and observations new insights into galaxy formation simulations via out-of-distribution detection and Bayesian model comparison : evaluating galaxy formation simulations under limited computing budgets and sparse dataset sizes |
| 773 | 1 | 8 | |g volume:701 |g year:2025 |g month:09 |g elocationid:A44 |g pages:1-18 |g extent:18 |a Bridging simulations and observations new insights into galaxy formation simulations via out-of-distribution detection and Bayesian model comparison : evaluating galaxy formation simulations under limited computing budgets and sparse dataset sizes |
| 856 | 4 | 0 | |u https://doi.org/10.1051/0004-6361/202453399 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |7 0 |
| 856 | 4 | 0 | |u https://www.aanda.org/articles/aa/abs/2025/09/aa53399-24/aa53399-24.html |x Verlag |z kostenfrei |3 Volltext |7 0 |
| 951 | |a AR | ||
| 992 | |a 20260129 | ||
| 993 | |a Article | ||
| 994 | |a 2025 | ||
| 998 | |g 1125036737 |a Buck, Tobias |m 1125036737:Buck, Tobias |d 700000 |d 708000 |e 700000PB1125036737 |e 708000PB1125036737 |k 0/700000/ |k 1/700000/708000/ |p 6 |y j | ||
| 998 | |g 1333330405 |a Obreja, Aura |m 1333330405:Obreja, Aura |d 700000 |d 708000 |e 700000PO1333330405 |e 708000PO1333330405 |k 0/700000/ |k 1/700000/708000/ |p 4 | ||
| 998 | |g 1354621018 |a Oliver, William H. |m 1354621018:Oliver, William H. |d 700000 |d 708000 |e 700000PO1354621018 |e 708000PO1354621018 |k 0/700000/ |k 1/700000/708000/ |p 3 | ||
| 999 | |a KXP-PPN195063308X |e 4864616051 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"language":["eng"],"title":[{"subtitle":"new insights into galaxy formation simulations via out-of-distribution detection and Bayesian model comparison : evaluating galaxy formation simulations under limited computing budgets and sparse dataset sizes","title":"Bridging simulations and observations","title_sort":"Bridging simulations and observations"}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"recId":"195063308X","origin":[{"dateIssuedDisp":"04 September 2025","dateIssuedKey":"2025"}],"note":["Gesehen am 29.01.2025"],"relHost":[{"id":{"zdb":["1458466-9"],"issn":["1432-0746"],"eki":["253390222"]},"disp":"Bridging simulations and observations new insights into galaxy formation simulations via out-of-distribution detection and Bayesian model comparison : evaluating galaxy formation simulations under limited computing budgets and sparse dataset sizesAstronomy and astrophysics","physDesc":[{"extent":"Online-Ressource"}],"note":["Gesehen am 21.06.2024","Erscheint 36mal jährlich in 12 Bänden zu je 3 Ausgaben","Fortsetzung der Druck-Ausgabe"],"corporate":[{"role":"isb","display":"European Southern Observatory"}],"recId":"253390222","origin":[{"publisher":"EDP Sciences ; Springer","dateIssuedDisp":"1969-","dateIssuedKey":"1969","publisherPlace":"Les Ulis ; Berlin ; Heidelberg"}],"type":{"bibl":"periodical","media":"Online-Ressource"},"titleAlt":[{"title":"Astronomy & astrophysics"},{"title":"a European journal"}],"name":{"displayForm":["European Southern Observatory (ESO)"]},"pubHistory":["1.1969 -"],"title":[{"subtitle":"an international weekly journal","title":"Astronomy and astrophysics","title_sort":"Astronomy and astrophysics"}],"language":["eng"],"part":{"extent":"18","pages":"1-18","volume":"701","text":"701(2025) vom: Sept., Artikel-ID A44, Seite 1-18","year":"2025"}}],"physDesc":[{"noteIll":"Illustrationen","extent":"18 S."}],"id":{"eki":["195063308X"],"doi":["10.1051/0004-6361/202453399"]},"name":{"displayForm":["Lingyi Zhou, Stefan T. Radev, William H. Oliver, Aura Obreja, Zehao Jin, and Tobias Buck"]},"person":[{"family":"Zhou","display":"Zhou, Lingyi","role":"aut","given":"Lingyi"},{"family":"Radev","given":"Stefan T.","role":"aut","display":"Radev, Stefan T."},{"role":"aut","given":"William H.","display":"Oliver, William H.","family":"Oliver"},{"family":"Obreja","display":"Obreja, Aura","given":"Aura","role":"aut"},{"family":"Jin","display":"Jin, Zehao","role":"aut","given":"Zehao"},{"display":"Buck, Tobias","given":"Tobias","role":"aut","family":"Buck"}]} | ||
| SRT | |a ZHOULINGYIBRIDGINGSI0420 | ||