Multistep networks for deformable multimodal medical image registration
We proposed neural networks for deformable multimodal medical image registration that use multiple steps and varying resolutions. The networks were trained jointly in an unsupervised manner with Mutual Information and Gradient L2 loss. By comparing the multistep neural networks to each other and to...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
11 June 2024
|
| In: |
IEEE access
Year: 2024, Volume: 12, Pages: 82676-82692 |
| ISSN: | 2169-3536 |
| DOI: | 10.1109/ACCESS.2024.3412216 |
| Online Access: | Verlag, kostenfrei, Volltext: https://doi.org/10.1109/ACCESS.2024.3412216 Verlag, kostenfrei, Volltext: http://ieeexplore.ieee.org/document/10552697 
|
| Author Notes: | Anika Strittmatter and Frank G. Zöllner, (Senior Member, IEEE) |
| Summary: | We proposed neural networks for deformable multimodal medical image registration that use multiple steps and varying resolutions. The networks were trained jointly in an unsupervised manner with Mutual Information and Gradient L2 loss. By comparing the multistep neural networks to each other and to a monostep/monoresolution network as a benchmark and the classical registration methods SimpleElastix and NiftyReg as a baseline, we investigated the impact of using multiple resolutions on the registration result. To assess the performance of the multistep networks, we used four three-dimensional multimodal datasets (a synthetic and an in-vivo liver dataset with CT and T1-weighted MR scans, an in-vivo kidney MR dataset with T1-weighted and T2-weighted MR scans and an in-vivo prostate MR dataset with T2-weighted and DWI MR scans). Experimental results showed that incorporating multiple steps and resolutions in a neural network leads to registration results with high structural similarity (NMI up to 0.33 ± 0.02, Dice up to 90.8 ± 3.1) and minimal image folding (|J \vert łe 0 : less than 0.5%), resulting in a medically plausible transformation, while maintaining a low registration time (<0.5 s). Moreover, our results demonstrate that spatial alignment improves with more resolutions/steps (up to 4 in this study), and multistep networks outperform monostage/monoresolution networks. |
|---|---|
| Item Description: | Gesehen am 22.10.2024 |
| Physical Description: | Online Resource |
| ISSN: | 2169-3536 |
| DOI: | 10.1109/ACCESS.2024.3412216 |