Navigating prevalence shifts in image analysis algorithm deployment
Domain gaps are significant obstacles to the clinical implementation of machine learning (ML) solutions for medical image analysis. Although current research emphasizes new training methods and network architectures, the specific impact of prevalence shifts on algorithms in real-world applications i...
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
May 2025
|
| In: |
Medical image analysis
Year: 2025, Jahrgang: 102, Pages: 1-14 |
| ISSN: | 1361-8423 |
| DOI: | 10.1016/j.media.2025.103504 |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1016/j.media.2025.103504 Verlag, kostenfrei, Volltext: https://www.sciencedirect.com/science/article/pii/S1361841525000520 
|
| Verfasserangaben: | Patrick Godau, Piotr Kalinowski, Evangelia Christodoulou, Annika Reinke, Minu Tizabi, Luciana Ferrer, Paul Jäger, Lena Maier-Hein |
MARC
| LEADER | 00000naa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1931886431 | ||
| 003 | DE-627 | ||
| 005 | 20250728123220.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 250728s2025 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.media.2025.103504 |2 doi | |
| 035 | |a (DE-627)1931886431 | ||
| 035 | |a (DE-599)KXP1931886431 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Godau, Patrick |d 1993- |e VerfasserIn |0 (DE-588)1179282515 |0 (DE-627)1066788200 |0 (DE-576)518174212 |4 aut | |
| 245 | 1 | 0 | |a Navigating prevalence shifts in image analysis algorithm deployment |c Patrick Godau, Piotr Kalinowski, Evangelia Christodoulou, Annika Reinke, Minu Tizabi, Luciana Ferrer, Paul Jäger, Lena Maier-Hein |
| 264 | 1 | |c May 2025 | |
| 300 | |b Illustrationen | ||
| 300 | |a 14 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Online verfügbar 19 February 2025, Version des Artikels 27 February 2025 | ||
| 500 | |a Gesehen am 28.07.2025 | ||
| 520 | |a Domain gaps are significant obstacles to the clinical implementation of machine learning (ML) solutions for medical image analysis. Although current research emphasizes new training methods and network architectures, the specific impact of prevalence shifts on algorithms in real-world applications is often overlooked. Differences in class frequencies between development and deployment data are crucial, particularly for the widespread adoption of artificial intelligence (AI), as disease prevalence can vary greatly across different times and locations. Our contribution is threefold. Based on a diverse set of 30 medical classification tasks (1) we demonstrate that lack of prevalence shift handling can have severe consequences on the quality of calibration, decision threshold, and performance assessment. Furthermore, (2) we show that prevalences can be accurately and reliably estimated in a data-driven manner. Finally, (3) we propose a new workflow for prevalence-aware image classification that uses estimated deployment prevalences to adjust a trained classifier to a new environment, without requiring additional annotated deployment data. Comprehensive experiments indicate that our proposed approach could contribute to generating better classifier decisions and more reliable performance estimates compared to current practice. | ||
| 650 | 4 | |a Class imbalance | |
| 650 | 4 | |a Domain gap | |
| 650 | 4 | |a Generalization | |
| 650 | 4 | |a Medical image classification | |
| 650 | 4 | |a Prevalence shift | |
| 700 | 1 | |a Kalinowski, Piotr |e VerfasserIn |4 aut | |
| 700 | 1 | |a Christodoulou, Evangelia |e VerfasserIn |0 (DE-588)134790574X |0 (DE-627)1908166002 |4 aut | |
| 700 | 1 | |a Reinke, Annika |d 1993- |e VerfasserIn |0 (DE-588)1219684252 |0 (DE-627)1735662143 |4 aut | |
| 700 | 1 | |a Tizabi, Minu |e VerfasserIn |4 aut | |
| 700 | 1 | |a Ferrer, Luciana |e VerfasserIn |4 aut | |
| 700 | 1 | |a Jäger, Paul |e VerfasserIn |4 aut | |
| 700 | 1 | |a Maier-Hein, Lena |d 1980- |e VerfasserIn |0 (DE-588)1075029252 |0 (DE-627)832869899 |0 (DE-576)190090804 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Medical image analysis |d Amsterdam [u.a.] : Elsevier Science, 1996 |g 102(2025) vom: Mai, Artikel-ID 103504, Seite 1-14 |h Online-Ressource |w (DE-627)306365081 |w (DE-600)1497450-2 |w (DE-576)091204941 |x 1361-8423 |7 nnas |a Navigating prevalence shifts in image analysis algorithm deployment |
| 773 | 1 | 8 | |g volume:102 |g year:2025 |g month:05 |g elocationid:103504 |g pages:1-14 |g extent:14 |a Navigating prevalence shifts in image analysis algorithm deployment |
| 856 | 4 | 0 | |u https://doi.org/10.1016/j.media.2025.103504 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 856 | 4 | 0 | |u https://www.sciencedirect.com/science/article/pii/S1361841525000520 |x Verlag |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20250728 | ||
| 993 | |a Article | ||
| 994 | |a 2025 | ||
| 998 | |g 1075029252 |a Maier-Hein, Lena |m 1075029252:Maier-Hein, Lena |d 910000 |d 910200 |e 910000PM1075029252 |e 910200PM1075029252 |k 0/910000/ |k 1/910000/910200/ |p 8 |y j | ||
| 998 | |g 1219684252 |a Reinke, Annika |m 1219684252:Reinke, Annika |d 50000 |e 50000PR1219684252 |k 0/50000/ |p 4 | ||
| 998 | |g 134790574X |a Christodoulou, Evangelia |m 134790574X:Christodoulou, Evangelia |d 50000 |e 50000PC134790574X |k 0/50000/ |p 3 | ||
| 998 | |g 1179282515 |a Godau, Patrick |m 1179282515:Godau, Patrick |d 110000 |e 110000PG1179282515 |k 0/110000/ |p 1 |x j | ||
| 999 | |a KXP-PPN1931886431 |e 4750087483 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"note":["Online verfügbar 19 February 2025, Version des Artikels 27 February 2025","Gesehen am 28.07.2025"],"relHost":[{"disp":"Navigating prevalence shifts in image analysis algorithm deploymentMedical image analysis","recId":"306365081","titleAlt":[{"title":"Medical image analysis online"}],"language":["eng"],"type":{"bibl":"periodical","media":"Online-Ressource"},"pubHistory":["1.1996/97 -"],"origin":[{"publisherPlace":"Amsterdam [u.a.]","dateIssuedKey":"1996","dateIssuedDisp":"1996-","publisher":"Elsevier Science"}],"title":[{"title_sort":"Medical image analysis","title":"Medical image analysis"}],"part":{"pages":"1-14","year":"2025","extent":"14","text":"102(2025) vom: Mai, Artikel-ID 103504, Seite 1-14","volume":"102"},"id":{"zdb":["1497450-2"],"issn":["1361-8423"],"eki":["306365081"]},"physDesc":[{"extent":"Online-Ressource"}],"note":["Gesehen am 16.05.23"]}],"id":{"eki":["1931886431"],"doi":["10.1016/j.media.2025.103504"]},"type":{"media":"Online-Ressource","bibl":"article-journal"},"physDesc":[{"noteIll":"Illustrationen","extent":"14 S."}],"title":[{"title":"Navigating prevalence shifts in image analysis algorithm deployment","title_sort":"Navigating prevalence shifts in image analysis algorithm deployment"}],"language":["eng"],"origin":[{"dateIssuedKey":"2025","dateIssuedDisp":"May 2025"}],"name":{"displayForm":["Patrick Godau, Piotr Kalinowski, Evangelia Christodoulou, Annika Reinke, Minu Tizabi, Luciana Ferrer, Paul Jäger, Lena Maier-Hein"]},"recId":"1931886431","person":[{"display":"Godau, Patrick","given":"Patrick","family":"Godau","role":"aut"},{"role":"aut","family":"Kalinowski","display":"Kalinowski, Piotr","given":"Piotr"},{"family":"Christodoulou","given":"Evangelia","display":"Christodoulou, Evangelia","role":"aut"},{"role":"aut","given":"Annika","display":"Reinke, Annika","family":"Reinke"},{"role":"aut","family":"Tizabi","display":"Tizabi, Minu","given":"Minu"},{"role":"aut","display":"Ferrer, Luciana","given":"Luciana","family":"Ferrer"},{"given":"Paul","display":"Jäger, Paul","family":"Jäger","role":"aut"},{"role":"aut","display":"Maier-Hein, Lena","given":"Lena","family":"Maier-Hein"}]} | ||
| SRT | |a GODAUPATRINAVIGATING2025 | ||