Test-time augmentation with synthetic data addresses distribution shifts in spectral imaging

Purpose: Surgical scene segmentation is crucial for providing context-aware surgical assistance. Recent studies highlight the significant advantages of hyperspectral imaging (HSI) over traditional RGB data in enhancing segmentation performance. Nevertheless, the current hyperspectral imaging (HSI) d...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Qasim, Ahmad Bin (VerfasserIn) , Motta, Alessandro (VerfasserIn) , Studier-Fischer, Alexander (VerfasserIn) , Sellner, Jan (VerfasserIn) , Ayala, Leonardo (VerfasserIn) , Hübner, Marco (VerfasserIn) , Bressan, Marc (VerfasserIn) , Özdemir, Berkin (VerfasserIn) , Kowalewski, Karl-Friedrich (VerfasserIn) , Nickel, Felix (VerfasserIn) , Seidlitz, Silvia (VerfasserIn) , Maier-Hein, Lena (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 14 March 2024
In: International journal of computer assisted radiology and surgery
Year: 2024, Jahrgang: 19, Heft: 6, Pages: 1021-1031
ISSN:1861-6429
DOI:10.1007/s11548-024-03085-3
Online-Zugang:Verlag, kostenfrei, Volltext: https://doi.org/10.1007/s11548-024-03085-3
Volltext
Verfasserangaben:Ahmad Bin Qasim, Alessandro Motta, Alexander Studier-Fischer, Jan Sellner, Leonardo Ayala, Marco Hübner, Marc Bressan, Berkin Özdemir, Karl Friedrich Kowalewski, Felix Nickel, Silvia Seidlitz, Lena Maier-Hein

MARC

LEADER 00000caa a2200000 c 4500
001 1896760945
003 DE-627
005 20250820125954.0
007 cr uuu---uuuuu
008 240729s2024 xx |||||o 00| ||eng c
024 7 |a 10.1007/s11548-024-03085-3  |2 doi 
035 |a (DE-627)1896760945 
035 |a (DE-599)KXP1896760945 
035 |a (OCoLC)1475304864 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Qasim, Ahmad Bin  |d 1994-  |e VerfasserIn  |0 (DE-588)1337181854  |0 (DE-627)1896765548  |4 aut 
245 1 0 |a Test-time augmentation with synthetic data addresses distribution shifts in spectral imaging  |c Ahmad Bin Qasim, Alessandro Motta, Alexander Studier-Fischer, Jan Sellner, Leonardo Ayala, Marco Hübner, Marc Bressan, Berkin Özdemir, Karl Friedrich Kowalewski, Felix Nickel, Silvia Seidlitz, Lena Maier-Hein 
264 1 |c 14 March 2024 
300 |b Illustrationen 
300 |a 11 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 29.07.2024 
520 |a Purpose: Surgical scene segmentation is crucial for providing context-aware surgical assistance. Recent studies highlight the significant advantages of hyperspectral imaging (HSI) over traditional RGB data in enhancing segmentation performance. Nevertheless, the current hyperspectral imaging (HSI) datasets remain limited and do not capture the full range of tissue variations encountered clinically. Methods: Based on a total of 615 hyperspectral images from a total of 16 pigs, featuring porcine organs in different perfusion states, we carry out an exploration of distribution shifts in spectral imaging caused by perfusion alterations. We further introduce a novel strategy to mitigate such distribution shifts, utilizing synthetic data for test-time augmentation. Results: The effect of perfusion changes on state-of-the-art (SOA) segmentation networks depended on the organ and the specific perfusion alteration induced. In the case of the kidney, we observed a performance decline of up to 93% when applying a state-of-the-art (SOA) network under ischemic conditions. Our method improved on the state-of-the-art (SOA) by up to 4.6 times. Conclusion: Given its potential wide-ranging relevance to diverse pathologies, our approach may serve as a pivotal tool to enhance neural network generalization within the realm of spectral imaging. 
650 4 |a Deep learning 
650 4 |a Domain generalization 
650 4 |a Hyperspectral imaging 
650 4 |a Surgical scene segmentation 
650 4 |a Test-time augmentation 
650 4 |a Tissue classification 
700 1 |a Motta, Alessandro  |e VerfasserIn  |4 aut 
700 1 |a Studier-Fischer, Alexander  |d 1995-  |e VerfasserIn  |0 (DE-588)1196041105  |0 (DE-627)1677916958  |4 aut 
700 1 |a Sellner, Jan  |d 1990-  |e VerfasserIn  |0 (DE-588)1333964773  |0 (DE-627)1892148137  |4 aut 
700 1 |a Ayala, Leonardo  |d 1994-  |e VerfasserIn  |0 (DE-588)1254842977  |0 (DE-627)1797630938  |4 aut 
700 1 |a Hübner, Marco  |e VerfasserIn  |0 (DE-588)125394556X  |0 (DE-627)1796368660  |4 aut 
700 1 |a Bressan, Marc  |d 1998-  |e VerfasserIn  |0 (DE-588)1365681602  |0 (DE-627)1925720969  |4 aut 
700 1 |a Özdemir, Berkin  |d 1997-  |e VerfasserIn  |0 (DE-588)1252285809  |0 (DE-627)1793432740  |4 aut 
700 1 |a Kowalewski, Karl-Friedrich  |d 1989-  |e VerfasserIn  |0 (DE-588)1100724192  |0 (DE-627)859518825  |0 (DE-576)469770740  |4 aut 
700 1 |a Nickel, Felix  |d 1982-  |e VerfasserIn  |0 (DE-588)1067980059  |0 (DE-627)819414875  |0 (DE-576)427122619  |4 aut 
700 1 |a Seidlitz, Silvia  |e VerfasserIn  |0 (DE-588)1264853750  |0 (DE-627)1813743282  |4 aut 
700 1 |a Maier-Hein, Lena  |d 1980-  |e VerfasserIn  |0 (DE-588)1075029252  |0 (DE-627)832869899  |0 (DE-576)190090804  |4 aut 
773 0 8 |i Enthalten in  |t International journal of computer assisted radiology and surgery  |d Berlin : Springer, 2006  |g 19(2024), 6, Seite 1021-1031  |h Online-Ressource  |w (DE-627)512299250  |w (DE-600)2235881-X  |w (DE-576)283119322  |x 1861-6429  |7 nnas  |a Test-time augmentation with synthetic data addresses distribution shifts in spectral imaging 
773 1 8 |g volume:19  |g year:2024  |g number:6  |g pages:1021-1031  |g extent:11  |a Test-time augmentation with synthetic data addresses distribution shifts in spectral imaging 
856 4 0 |u https://doi.org/10.1007/s11548-024-03085-3  |x Verlag  |x Resolving-System  |z kostenfrei  |3 Volltext 
951 |a AR 
992 |a 20240729 
993 |a Article 
994 |a 2024 
998 |g 1075029252  |a Maier-Hein, Lena  |m 1075029252:Maier-Hein, Lena  |d 110000  |e 110000PM1075029252  |k 0/110000/  |p 12  |y j 
998 |g 1264853750  |a Seidlitz, Silvia  |m 1264853750:Seidlitz, Silvia  |d 110000  |e 110000PS1264853750  |k 0/110000/  |p 11 
998 |g 1067980059  |a Nickel, Felix  |m 1067980059:Nickel, Felix  |d 910000  |d 910200  |d 50000  |e 910000PN1067980059  |e 910200PN1067980059  |e 50000PN1067980059  |k 0/910000/  |k 1/910000/910200/  |k 0/50000/  |p 10 
998 |g 1100724192  |a Kowalewski, Karl-Friedrich  |m 1100724192:Kowalewski, Karl-Friedrich  |d 60000  |d 63100  |e 60000PK1100724192  |e 63100PK1100724192  |k 0/60000/  |k 1/60000/63100/  |p 9 
998 |g 1252285809  |a Özdemir, Berkin  |m 1252285809:Özdemir, Berkin  |d 50000  |e 50000PO1252285809  |k 0/50000/  |p 8 
998 |g 1365681602  |a Bressan, Marc  |m 1365681602:Bressan, Marc  |d 50000  |e 50000PB1365681602  |k 0/50000/  |p 7 
998 |g 125394556X  |a Hübner, Marco  |m 125394556X:Hübner, Marco  |d 110000  |e 110000PH125394556X  |k 0/110000/  |p 6 
998 |g 1254842977  |a Ayala, Leonardo  |m 1254842977:Ayala, Leonardo  |p 5 
998 |g 1333964773  |a Sellner, Jan  |m 1333964773:Sellner, Jan  |d 110000  |e 110000PS1333964773  |k 0/110000/  |p 4 
998 |g 1196041105  |a Studier-Fischer, Alexander  |m 1196041105:Studier-Fischer, Alexander  |d 60000  |d 63100  |e 60000PS1196041105  |e 63100PS1196041105  |k 0/60000/  |k 1/60000/63100/  |p 3 
998 |g 1337181854  |a Qasim, Ahmad Bin  |m 1337181854:Qasim, Ahmad Bin  |d 110000  |e 110000PQ1337181854  |k 0/110000/  |p 1  |x j 
999 |a KXP-PPN1896760945  |e 4559855188 
BIB |a Y 
SER |a journal 
JSO |a {"note":["Gesehen am 29.07.2024"],"id":{"doi":["10.1007/s11548-024-03085-3"],"eki":["1896760945"]},"title":[{"title":"Test-time augmentation with synthetic data addresses distribution shifts in spectral imaging","title_sort":"Test-time augmentation with synthetic data addresses distribution shifts in spectral imaging"}],"recId":"1896760945","relHost":[{"recId":"512299250","pubHistory":["1.2006/07 -"],"type":{"media":"Online-Ressource","bibl":"periodical"},"origin":[{"publisher":"Springer","dateIssuedDisp":"2006-","dateIssuedKey":"2006","publisherPlace":"Berlin ; Heidelberg [u.a.]"}],"language":["eng"],"physDesc":[{"extent":"Online-Ressource"}],"part":{"extent":"11","year":"2024","pages":"1021-1031","text":"19(2024), 6, Seite 1021-1031","issue":"6","volume":"19"},"disp":"Test-time augmentation with synthetic data addresses distribution shifts in spectral imagingInternational journal of computer assisted radiology and surgery","note":["Gesehen am 26.02.14","Fortsetzung der Druck-Ausgabe"],"title":[{"title":"International journal of computer assisted radiology and surgery","title_sort":"International journal of computer assisted radiology and surgery","subtitle":"a journal for interdisciplinary research, development and applications of image guided diagnosis and therapy"}],"id":{"issn":["1861-6429"],"zdb":["2235881-X"],"eki":["512299250"]}}],"name":{"displayForm":["Ahmad Bin Qasim, Alessandro Motta, Alexander Studier-Fischer, Jan Sellner, Leonardo Ayala, Marco Hübner, Marc Bressan, Berkin Özdemir, Karl Friedrich Kowalewski, Felix Nickel, Silvia Seidlitz, Lena Maier-Hein"]},"person":[{"family":"Qasim","roleDisplay":"VerfasserIn","given":"Ahmad Bin","display":"Qasim, Ahmad Bin","role":"aut"},{"display":"Motta, Alessandro","role":"aut","given":"Alessandro","family":"Motta","roleDisplay":"VerfasserIn"},{"family":"Studier-Fischer","roleDisplay":"VerfasserIn","display":"Studier-Fischer, Alexander","role":"aut","given":"Alexander"},{"display":"Sellner, Jan","role":"aut","given":"Jan","family":"Sellner","roleDisplay":"VerfasserIn"},{"given":"Leonardo","display":"Ayala, Leonardo","role":"aut","roleDisplay":"VerfasserIn","family":"Ayala"},{"given":"Marco","display":"Hübner, Marco","role":"aut","roleDisplay":"VerfasserIn","family":"Hübner"},{"role":"aut","display":"Bressan, Marc","given":"Marc","roleDisplay":"VerfasserIn","family":"Bressan"},{"family":"Özdemir","roleDisplay":"VerfasserIn","display":"Özdemir, Berkin","role":"aut","given":"Berkin"},{"display":"Kowalewski, Karl-Friedrich","role":"aut","given":"Karl-Friedrich","family":"Kowalewski","roleDisplay":"VerfasserIn"},{"roleDisplay":"VerfasserIn","family":"Nickel","display":"Nickel, Felix","role":"aut","given":"Felix"},{"family":"Seidlitz","roleDisplay":"VerfasserIn","given":"Silvia","display":"Seidlitz, Silvia","role":"aut"},{"given":"Lena","role":"aut","display":"Maier-Hein, Lena","roleDisplay":"VerfasserIn","family":"Maier-Hein"}],"physDesc":[{"noteIll":"Illustrationen","extent":"11 S."}],"language":["eng"],"origin":[{"dateIssuedKey":"2024","dateIssuedDisp":"14 March 2024"}],"type":{"bibl":"article-journal","media":"Online-Ressource"}} 
SRT |a QASIMAHMADTESTTIMEAU1420