Multi-modal dataset creation for federated learning with DICOM-structured reports
Purpose: Federated training is often challenging on heterogeneous datasets due to divergent data storage options, inconsistent naming schemes, varied annotation procedures, and disparities in label quality. This is particularly evident in the emerging multi-modal learning paradigms, where dataset ha...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
03 February 2025
|
| In: |
International journal of computer assisted radiology and surgery
Year: 2025, Jahrgang: 20, Heft: 3, Pages: 485495 |
| ISSN: | 18616429 |
| DOI: | 10.1007/s11548-025-03327-y |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1007/s11548-025-03327-y
|
| Verfasserangaben: | Malte Tölle, Lukas Burger, Halvar Kelm, Florian André, Peter Bannas, Gerhard Diller, Norbert Frey, Philipp Garthe, Stefan Groß, Anja Hennemuth, Lars Kaderali, Nina Krüger, Andreas Leha, Simon Martin, Alexander Meyer, Eike Nagel, Stefan Orwat, Clemens Scherer, Moritz Seiffert, Jan Moritz Seliger, Stefan Simm, Tim Friede, Tim Seidler, Sandy Engelhardt |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1932511423 | ||
| 003 | DE-627 | ||
| 005 | 20251023214132.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 250805s2025 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1007/s11548-025-03327-y |2 doi | |
| 035 | |a (DE-627)1932511423 | ||
| 035 | |a (DE-599)KXP1932511423 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Tölle, Malte |e VerfasserIn |0 (DE-588)1259770931 |0 (DE-627)180687444X |4 aut | |
| 245 | 1 | 0 | |a Multi-modal dataset creation for federated learning with DICOM-structured reports |c Malte Tölle, Lukas Burger, Halvar Kelm, Florian André, Peter Bannas, Gerhard Diller, Norbert Frey, Philipp Garthe, Stefan Groß, Anja Hennemuth, Lars Kaderali, Nina Krüger, Andreas Leha, Simon Martin, Alexander Meyer, Eike Nagel, Stefan Orwat, Clemens Scherer, Moritz Seiffert, Jan Moritz Seliger, Stefan Simm, Tim Friede, Tim Seidler, Sandy Engelhardt |
| 264 | 1 | |c 03 February 2025 | |
| 300 | |b Illustrationen | ||
| 300 | |a 11 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 05.08.2025 | ||
| 520 | |a Purpose: Federated training is often challenging on heterogeneous datasets due to divergent data storage options, inconsistent naming schemes, varied annotation procedures, and disparities in label quality. This is particularly evident in the emerging multi-modal learning paradigms, where dataset harmonization including a uniform data representation and filtering options are of paramount importance. Methods: DICOM-structured reports enable the standardized linkage of arbitrary information beyond the imaging domain and can be used within Python deep learning pipelines with highdicom. Building on this, we developed an open platform for data integration with interactive filtering capabilities, thereby simplifying the process of creation of patient cohorts over several sites with consistent multi-modal data. Results: In this study, we extend our prior work by showing its applicability to more and divergent data types, as well as streamlining datasets for federated training within an established consortium of eight university hospitals in Germany. We prove its concurrent filtering ability by creating harmonized multi-modal datasets across all locations for predicting the outcome after minimally invasive heart valve replacement. The data include imaging and waveform data (i.e., computed tomography images, electrocardiography scans) as well as annotations (i.e., calcification segmentations, and pointsets), and metadata (i.e., prostheses and pacemaker dependency). Conclusion: Structured reports bridge the traditional gap between imaging systems and information systems. Utilizing the inherent DICOM reference system arbitrary data types can be queried concurrently to create meaningful cohorts for multi-centric data analysis. The graphical interface as well as example structured report templates are available at https://github.com/Cardio-AI/fl-multi-modal-dataset-creation. | ||
| 650 | 4 | |a Big Data | |
| 650 | 4 | |a Data Engineering | |
| 650 | 4 | |a Data integration | |
| 650 | 4 | |a Data Storage Representation | |
| 650 | 4 | |a Data-filtering | |
| 650 | 4 | |a DICOM | |
| 650 | 4 | |a Federated learning | |
| 650 | 4 | |a Health Informatics | |
| 650 | 4 | |a Information Model | |
| 650 | 4 | |a Multi-modal | |
| 650 | 4 | |a Structured reports | |
| 650 | 4 | |a Transcatheter aortic valve replacement | |
| 700 | 1 | |a Burger, Lukas |e VerfasserIn |0 (DE-588)1323732454 |0 (DE-627)1883687217 |4 aut | |
| 700 | 1 | |a Kelm, Halvar |e VerfasserIn |0 (DE-588)1255070277 |0 (DE-627)179814350X |4 aut | |
| 700 | 1 | |a André, Florian |d 1983- |e VerfasserIn |0 (DE-588)1051060230 |0 (DE-627)785671714 |0 (DE-576)405733267 |4 aut | |
| 700 | 1 | |8 1\p |a Bannas, Peter |d 1977- |e VerfasserIn |0 (DE-588)134128087 |0 (DE-627)561347352 |0 (DE-576)300329628 |4 aut | |
| 700 | 1 | |a Diller, Gerhard |e VerfasserIn |4 aut | |
| 700 | 1 | |a Frey, Norbert |e VerfasserIn |0 (DE-588)141244976 |0 (DE-627)625824075 |0 (DE-576)322969514 |4 aut | |
| 700 | 1 | |a Garthe, Philipp |e VerfasserIn |4 aut | |
| 700 | 1 | |a Groß, Stefan |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hennemuth, Anja |e VerfasserIn |4 aut | |
| 700 | 1 | |8 2\p |a Kaderali, Lars |d 1974- |e VerfasserIn |0 (DE-588)131908898 |0 (DE-627)516072145 |0 (DE-576)298829193 |4 aut | |
| 700 | 1 | |a Krüger, Nina |e VerfasserIn |4 aut | |
| 700 | 1 | |a Leha, Andreas |e VerfasserIn |4 aut | |
| 700 | 1 | |8 3\p |a Martin, Simon |d 1987- |e VerfasserIn |0 (DE-588)1072530090 |0 (DE-627)827692706 |0 (DE-576)434008044 |4 aut | |
| 700 | 1 | |a Meyer, Alexander |e VerfasserIn |4 aut | |
| 700 | 1 | |8 4\p |a Nagel, Eike |d 1967- |e VerfasserIn |0 (DE-588)124879802 |0 (DE-627)367429535 |0 (DE-576)294548335 |4 aut | |
| 700 | 1 | |8 5\p |a Orwat, Stefan |d 1973- |e VerfasserIn |0 (DE-588)129448389 |0 (DE-627)397658443 |0 (DE-576)29766509X |4 aut | |
| 700 | 1 | |a Scherer, Clemens |e VerfasserIn |4 aut | |
| 700 | 1 | |8 6\p |a Seiffert, Moritz |d 1981- |e VerfasserIn |0 (DE-588)137207239 |0 (DE-627)591016257 |0 (DE-576)302814639 |4 aut | |
| 700 | 1 | |a Seliger, Jan Moritz |e VerfasserIn |4 aut | |
| 700 | 1 | |a Simm, Stefan |e VerfasserIn |4 aut | |
| 700 | 1 | |8 7\p |a Friede, Tim |d 1971- |e VerfasserIn |0 (DE-588)123130999 |0 (DE-627)082365156 |0 (DE-576)183804082 |4 aut | |
| 700 | 1 | |8 8\p |a Seidler, Tim |d 1974- |e VerfasserIn |0 (DE-588)124389953 |0 (DE-627)706622677 |0 (DE-576)186480970 |4 aut | |
| 700 | 1 | |a Engelhardt, Sandy |d 1987- |e VerfasserIn |0 (DE-588)1122674465 |0 (DE-627)876003080 |0 (DE-576)481436049 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t International journal of computer assisted radiology and surgery |d Berlin : Springer, 2006 |g 20(2025), 3, Seite 485495 |h OnlineRessource |w (DE-627)512299250 |w (DE-600)2235881X |w (DE-576)283119322 |x 18616429 |7 nnas |a Multi-modal dataset creation for federated learning with DICOM-structured reports |
| 773 | 1 | 8 | |g volume:20 |g year:2025 |g number:3 |g pages:485495 |g extent:11 |a Multi-modal dataset creation for federated learning with DICOM-structured reports |
| 856 | 4 | 0 | |u https://doi.org/10.1007/s11548-025-03327-y |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 883 | |8 1\p |a cgwrk |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 883 | |8 2\p |a cgwrk |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 883 | |8 3\p |a cgwrk |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 883 | |8 4\p |a cgwrk |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 883 | |8 5\p |a cgwrk |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 883 | |8 6\p |a cgwrk |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 883 | |8 7\p |a cgwrk |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 883 | |8 8\p |a cgwrk |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 951 | |a AR | ||
| 992 | |a 20250805 | ||
| 993 | |a Article | ||
| 994 | |a 2025 | ||
| 998 | |g 1122674465 |a Engelhardt, Sandy |m 1122674465:Engelhardt, Sandy |d 910000 |d 910100 |e 910000PE1122674465 |e 910100PE1122674465 |k 0/910000/ |k 1/910000/910100/ |p 24 |y j | ||
| 998 | |g 141244976 |a Frey, Norbert |m 141244976:Frey, Norbert |d 910000 |d 910100 |e 910000PF141244976 |e 910100PF141244976 |k 0/910000/ |k 1/910000/910100/ |p 7 | ||
| 998 | |g 1051060230 |a André, Florian |m 1051060230:André, Florian |d 910000 |d 910100 |d 50000 |e 910000PA1051060230 |e 910100PA1051060230 |e 50000PA1051060230 |k 0/910000/ |k 1/910000/910100/ |k 0/50000/ |p 4 | ||
| 998 | |g 1255070277 |a Kelm, Halvar |m 1255070277:Kelm, Halvar |d 910000 |d 910100 |e 910000PK1255070277 |e 910100PK1255070277 |k 0/910000/ |k 1/910000/910100/ |p 3 | ||
| 998 | |g 1323732454 |a Burger, Lukas |m 1323732454:Burger, Lukas |d 910000 |d 910100 |e 910000PB1323732454 |e 910100PB1323732454 |k 0/910000/ |k 1/910000/910100/ |p 2 | ||
| 998 | |g 1259770931 |a Tölle, Malte |m 1259770931:Tölle, Malte |d 910000 |d 910100 |e 910000PT1259770931 |e 910100PT1259770931 |k 0/910000/ |k 1/910000/910100/ |p 1 |x j | ||
| 999 | |a KXP-PPN1932511423 |e 4753274047 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"relHost":[{"part":{"volume":"20","pages":"485495","text":"20(2025), 3, Seite 485495","issue":"3","extent":"11","year":"2025"},"disp":"Multi-modal dataset creation for federated learning with DICOM-structured reportsInternational journal of computer assisted radiology and surgery","pubHistory":["1.2006/07 -"],"type":{"bibl":"periodical","media":"Online-Ressource"},"recId":"512299250","note":["Gesehen am 26.02.14","Fortsetzung der Druck-Ausgabe"],"language":["eng"],"physDesc":[{"extent":"Online-Ressource"}],"title":[{"subtitle":"a journal for interdisciplinary research, development and applications of image guided diagnosis and therapy","title":"International journal of computer assisted radiology and surgery","title_sort":"International journal of computer assisted radiology and surgery"}],"origin":[{"dateIssuedDisp":"2006-","dateIssuedKey":"2006","publisherPlace":"Berlin ; Heidelberg [u.a.]","publisher":"Springer"}],"id":{"issn":["1861-6429","18616429"],"zdb":["2235881-X"],"eki":["512299250"]}}],"type":{"media":"Online-Ressource","bibl":"article-journal"},"person":[{"given":"Malte","display":"Tölle, Malte","family":"Tölle","role":"aut"},{"family":"Burger","display":"Burger, Lukas","role":"aut","given":"Lukas"},{"given":"Halvar","role":"aut","family":"Kelm","display":"Kelm, Halvar"},{"given":"Florian","family":"André","display":"André, Florian","role":"aut"},{"given":"Peter","role":"aut","family":"Bannas","display":"Bannas, Peter"},{"given":"Gerhard","role":"aut","display":"Diller, Gerhard","family":"Diller"},{"given":"Norbert","family":"Frey","display":"Frey, Norbert","role":"aut"},{"given":"Philipp","family":"Garthe","display":"Garthe, Philipp","role":"aut"},{"given":"Stefan","display":"Groß, Stefan","family":"Groß","role":"aut"},{"given":"Anja","role":"aut","display":"Hennemuth, Anja","family":"Hennemuth"},{"role":"aut","family":"Kaderali","display":"Kaderali, Lars","given":"Lars"},{"role":"aut","display":"Krüger, Nina","family":"Krüger","given":"Nina"},{"role":"aut","display":"Leha, Andreas","family":"Leha","given":"Andreas"},{"given":"Simon","role":"aut","display":"Martin, Simon","family":"Martin"},{"given":"Alexander","display":"Meyer, Alexander","family":"Meyer","role":"aut"},{"given":"Eike","role":"aut","family":"Nagel","display":"Nagel, Eike"},{"given":"Stefan","role":"aut","family":"Orwat","display":"Orwat, Stefan"},{"given":"Clemens","role":"aut","display":"Scherer, Clemens","family":"Scherer"},{"given":"Moritz","role":"aut","display":"Seiffert, Moritz","family":"Seiffert"},{"role":"aut","family":"Seliger","display":"Seliger, Jan Moritz","given":"Jan Moritz"},{"given":"Stefan","role":"aut","family":"Simm","display":"Simm, Stefan"},{"given":"Tim","display":"Friede, Tim","family":"Friede","role":"aut"},{"role":"aut","family":"Seidler","display":"Seidler, Tim","given":"Tim"},{"role":"aut","family":"Engelhardt","display":"Engelhardt, Sandy","given":"Sandy"}],"id":{"eki":["1932511423"],"doi":["10.1007/s11548-025-03327-y"]},"recId":"1932511423","origin":[{"dateIssuedDisp":"03 February 2025","dateIssuedKey":"2025"}],"name":{"displayForm":["Malte Tölle, Lukas Burger, Halvar Kelm, Florian André, Peter Bannas, Gerhard Diller, Norbert Frey, Philipp Garthe, Stefan Groß, Anja Hennemuth, Lars Kaderali, Nina Krüger, Andreas Leha, Simon Martin, Alexander Meyer, Eike Nagel, Stefan Orwat, Clemens Scherer, Moritz Seiffert, Jan Moritz Seliger, Stefan Simm, Tim Friede, Tim Seidler, Sandy Engelhardt"]},"note":["Gesehen am 05.08.2025"],"language":["eng"],"physDesc":[{"noteIll":"Illustrationen","extent":"11 S."}],"title":[{"title":"Multi-modal dataset creation for federated learning with DICOM-structured reports","title_sort":"Multi-modal dataset creation for federated learning with DICOM-structured reports"}]} | ||
| SRT | |a TOELLEMALTMULTIMODAL0320 | ||