Reconstructing and analyzing the invariances of low-dose CT image denoising networks

Background Deep learning-based methods led to significant advancements in many areas of medical imaging, most of which are concerned with the reduction of artifacts caused by motion, scatter, or noise. However, with most neural networks being black boxes, they remain notoriously difficult to interpr...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Eulig, Elias (VerfasserIn) , Jäger, Fabian (VerfasserIn) , Maier, Joscha (VerfasserIn) , Ommer, Björn (VerfasserIn) , Kachelrieß, Marc (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: January 2025
In: Medical physics
Year: 2025, Jahrgang: 52, Heft: 1, Pages: 188-200
ISSN:2473-4209
DOI:10.1002/mp.17413
Online-Zugang:Verlag, kostenfrei, Volltext: https://doi.org/10.1002/mp.17413
Verlag, kostenfrei, Volltext: https://onlinelibrary.wiley.com/doi/abs/10.1002/mp.17413
Volltext
Verfasserangaben:Elias Eulig, Fabian Jäger, Joscha Maier, Björn Ommer, Marc Kachelrieß
Beschreibung
Zusammenfassung:Background Deep learning-based methods led to significant advancements in many areas of medical imaging, most of which are concerned with the reduction of artifacts caused by motion, scatter, or noise. However, with most neural networks being black boxes, they remain notoriously difficult to interpret, hindering their clinical implementation. In particular, it has been shown that networks exhibit invariances w.r.t. input features, that is, they learn to ignore certain information in the input data. Purpose To improve the interpretability of deep learning-based low-dose CT image denoising networks. Methods We learn a complete data representation of low-dose input images using a conditional variational autoencoder (cVAE). In this representation, invariances of any given denoising network are then disentangled from the information it is not invariant to using a conditional invertible neural network (cINN). At test time, image-space invariances are generated by applying the inverse of the cINN and subsequent decoding using the cVAE. We propose two methods to analyze sampled invariances and to find those that correspond to alterations of anatomical structures. Results The proposed method is applied to four popular deep learning-based low-dose CT image denoising networks. We find that the networks are not only invariant to noise amplitude and realizations, but also to anatomical structures. Conclusions The proposed method is capable of reconstructing and analyzing invariances of deep learning-based low-dose CT image denoising networks. This is an important step toward interpreting deep learning-based methods for medical imaging, which is essential for their clinical implementation.
Beschreibung:Gesehen am 14.03.2025
Beschreibung:Online Resource
ISSN:2473-4209
DOI:10.1002/mp.17413