Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions - a comparative study on generalizability

Multimodal image registration is applied in medical image analysis as it allows the integration of complementary data from multiple imaging modalities. In recent years, various neural network-based approaches for medical image registration have been presented in papers, but due to the use of differe...

Full description

Saved in:
Bibliographic Details
Main Authors: Strittmatter, Anika (Author) , Schad, Lothar R. (Author) , Zöllner, Frank G. (Author)
Format: Article (Journal)
Language:English
Published: May 2024
In: Zeitschrift für medizinische Physik
Year: 2024, Volume: 34, Issue: 2, Pages: 291-317
ISSN:1876-4436
DOI:10.1016/j.zemedi.2023.05.003
Online Access:Verlag, kostenfrei, Volltext: https://doi.org/10.1016/j.zemedi.2023.05.003
Verlag, kostenfrei, Volltext: https://www.sciencedirect.com/science/article/pii/S0939388923000715
Get full text
Author Notes:Anika Strittmatter, Lothar R. Schad, Frank G. Zöllner

MARC

LEADER 00000caa a2200000 c 4500
001 1908764163
003 DE-627
005 20241205220806.0
007 cr uuu---uuuuu
008 241115s2024 xx |||||o 00| ||eng c
024 7 |a 10.1016/j.zemedi.2023.05.003  |2 doi 
035 |a (DE-627)1908764163 
035 |a (DE-599)KXP1908764163 
035 |a (OCoLC)1475647537 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Strittmatter, Anika  |d 1997-  |e VerfasserIn  |0 (DE-588)1344822703  |0 (DE-627)1905543174  |4 aut 
245 1 0 |a Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions - a comparative study on generalizability  |c Anika Strittmatter, Lothar R. Schad, Frank G. Zöllner 
264 1 |c May 2024 
300 |b Illustrationen 
300 |a 27 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Online verfügbar: 22. Juni 2023, Artikelversion: 24. Mai 2024 
500 |a Gesehen am 15.11.2024 
520 |a Multimodal image registration is applied in medical image analysis as it allows the integration of complementary data from multiple imaging modalities. In recent years, various neural network-based approaches for medical image registration have been presented in papers, but due to the use of different datasets, a fair comparison is not possible. In this research 20 different neural networks for an affine registration of medical images were implemented. The networks’ performance and the networks’ generalizability to new datasets were evaluated using two multimodal datasets - a synthetic and a real patient dataset - of three-dimensional CT and MR images of the liver. The networks were first trained semi-supervised using the synthetic dataset and then evaluated on the synthetic dataset and the unseen patient dataset. Afterwards, the networks were finetuned on the patient dataset and subsequently evaluated on the patient dataset. The networks were compared using our own developed CNN as benchmark and a conventional affine registration with SimpleElastix as baseline. Six networks improved the pre-registration Dice coefficient of the synthetic dataset significantly (p-value <0.05) and nine networks improved the pre-registration Dice coefficient of the patient dataset significantly and are therefore able to generalize to the new datasets used in our experiments. Many different machine learning-based methods have been proposed for affine multimodal medical image registration, but few are generalizable to new data and applications. It is therefore necessary to conduct further research in order to develop medical image registration techniques that can be applied more widely. 
650 4 |a Affine 
650 4 |a Deep learning 
650 4 |a Medical images 
650 4 |a Multimodal data 
650 4 |a Neural networks 
650 4 |a Registration 
700 1 |a Schad, Lothar R.  |d 1956-  |e VerfasserIn  |0 (DE-588)1028817630  |0 (DE-627)731640241  |0 (DE-576)376271221  |4 aut 
700 1 |a Zöllner, Frank G.  |d 1976-  |e VerfasserIn  |0 (DE-588)129580015  |0 (DE-627)473357054  |0 (DE-576)297732587  |4 aut 
773 0 8 |i Enthalten in  |t Zeitschrift für medizinische Physik  |d Amsterdam [u.a.] : Elsevier, 1990  |g 34(2024), 2, Seite 291-317  |w (DE-627)510617662  |w (DE-600)2231492-1  |w (DE-576)272350818  |x 1876-4436  |7 nnas  |a Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions - a comparative study on generalizability 
773 1 8 |g volume:34  |g year:2024  |g number:2  |g pages:291-317  |g extent:27  |a Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions - a comparative study on generalizability 
856 4 0 |u https://doi.org/10.1016/j.zemedi.2023.05.003  |x Verlag  |x Resolving-System  |z kostenfrei  |3 Volltext 
856 4 0 |u https://www.sciencedirect.com/science/article/pii/S0939388923000715  |x Verlag  |z kostenfrei  |3 Volltext 
951 |a AR 
992 |a 20241115 
993 |a Article 
994 |a 2024 
998 |g 129580015  |a Zöllner, Frank G.  |m 129580015:Zöllner, Frank G.  |d 60000  |d 65200  |d 60000  |e 60000PZ129580015  |e 65200PZ129580015  |e 60000PZ129580015  |k 0/60000/  |k 1/60000/65200/  |k 0/60000/  |p 3  |y j 
998 |g 1028817630  |a Schad, Lothar R.  |m 1028817630:Schad, Lothar R.  |d 60000  |d 65200  |d 60000  |e 60000PS1028817630  |e 65200PS1028817630  |e 60000PS1028817630  |k 0/60000/  |k 1/60000/65200/  |k 0/60000/  |p 2 
998 |g 1344822703  |a Strittmatter, Anika  |m 1344822703:Strittmatter, Anika  |d 60000  |d 65200  |e 60000PS1344822703  |e 65200PS1344822703  |k 0/60000/  |k 1/60000/65200/  |p 1  |x j 
999 |a KXP-PPN1908764163  |e 461527498X 
BIB |a Y 
SER |a journal 
JSO |a {"language":["eng"],"type":{"media":"Online-Ressource","bibl":"article-journal"},"origin":[{"dateIssuedDisp":"May 2024","dateIssuedKey":"2024"}],"relHost":[{"note":["Gesehen am 31.01.2022"],"disp":"Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions - a comparative study on generalizabilityZeitschrift für medizinische Physik","id":{"eki":["510617662"],"zdb":["2231492-1"],"issn":["1876-4436"]},"title":[{"title_sort":"Zeitschrift für medizinische Physik","title":"Zeitschrift für medizinische Physik","subtitle":"offizielles Organ der Deutschen, Österreichischen und Schweizerischen Gesellschaft für Medizinische Physik"}],"type":{"media":"Online-Ressource","bibl":"periodical"},"origin":[{"dateIssuedDisp":"1990-","dateIssuedKey":"1990","publisherPlace":"Amsterdam [u.a.]","publisher":"Elsevier"}],"language":["ger"],"part":{"year":"2024","extent":"27","pages":"291-317","text":"34(2024), 2, Seite 291-317","volume":"34","issue":"2"},"recId":"510617662","corporate":[{"display":"Deutsche Gesellschaft für Medizinische Physik","role":"isb","roleDisplay":"Herausgebendes Organ"},{"roleDisplay":"Herausgebendes Organ","role":"isb","display":"Österreichische Gesellschaft für Medizinische Physik"}],"titleAlt":[{"title":"Medizinische Physik"}],"pubHistory":["Volume 1, supplement (1990) ; volume 1, issue 1 (1991)-"]}],"physDesc":[{"extent":"27 S.","noteIll":"Illustrationen"}],"person":[{"given":"Anika","display":"Strittmatter, Anika","role":"aut","family":"Strittmatter","roleDisplay":"VerfasserIn"},{"role":"aut","display":"Schad, Lothar R.","given":"Lothar R.","family":"Schad","roleDisplay":"VerfasserIn"},{"given":"Frank G.","role":"aut","display":"Zöllner, Frank G.","family":"Zöllner","roleDisplay":"VerfasserIn"}],"name":{"displayForm":["Anika Strittmatter, Lothar R. Schad, Frank G. Zöllner"]},"note":["Online verfügbar: 22. Juni 2023, Artikelversion: 24. Mai 2024","Gesehen am 15.11.2024"],"id":{"doi":["10.1016/j.zemedi.2023.05.003"],"eki":["1908764163"]},"title":[{"title_sort":"Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions - a comparative study on generalizability","title":"Deep learning-based affine medical image registration for multimodal minimal-invasive image-guided interventions - a comparative study on generalizability"}],"recId":"1908764163"} 
SRT |a STRITTMATTDEEPLEARNI2024