Pseudoprospective paraclinical interaction of radiology residents with a deep learning system for prostate cancer detection: experience, performance, and identification of the need for intermittent recalibration

Objectives - The aim of this study was to estimate the prospective utility of a previously retrospectively validated convolutional neural network (CNN) for prostate cancer (PC) detection on prostate magnetic resonance imaging (MRI). - Materials and Methods - The biparametri...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Kevin Sun (VerfasserIn) , Schelb, Patrick (VerfasserIn) , Netzer, Nils (VerfasserIn) , Tavakoli, Andrej (VerfasserIn) , Keymling, Myriam (VerfasserIn) , Wehrse, Eckhard (VerfasserIn) , Hog, Robert (VerfasserIn) , Rotkopf, Lukas Thomas (VerfasserIn) , Wennmann, Markus (VerfasserIn) , Glemser, Philip (VerfasserIn) , Thierjung, Heidi (VerfasserIn) , Knebel Doeberitz, Nikolaus von (VerfasserIn) , Kleesiek, Jens Philipp (VerfasserIn) , Görtz, Magdalena (VerfasserIn) , Schütz, Viktoria (VerfasserIn) , Hielscher, Thomas (VerfasserIn) , Stenzinger, Albrecht (VerfasserIn) , Hohenfellner, Markus (VerfasserIn) , Schlemmer, Heinz-Peter (VerfasserIn) , Maier-Hein, Klaus H. (VerfasserIn) , Bonekamp, David (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 2022
In: Investigative radiology
Year: 2022, Jahrgang: 57, Heft: 9, Pages: 601-612
ISSN:1536-0210
DOI:10.1097/RLI.0000000000000878
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1097/RLI.0000000000000878
Verlag, lizenzpflichtig, Volltext: https://journals.lww.com/investigativeradiology/Abstract/2022/09000/Pseudoprospective_Paraclinical_Interaction_of.6.aspx
Volltext
Verfasserangaben:Kevin Sun Zhang, Patrick Schelb, Nils Netzer, Anoshirwan Andrej Tavakoli, Myriam Keymling, Eckhard Wehrse, Robert Hog, Lukas Thomas Rotkopf, Markus Wennmann, Philip Alexander Glemser, Heidi Thierjung, Nikolaus von Knebel Doeberitz, Jens Kleesiek, Magdalena Görtz, Viktoria Schütz, Thomas Hielscher, Albrecht Stenzinger, Markus Hohenfellner, Heinz-Peter Schlemmer, Klaus Maier-Hein, David Bonekamp

MARC

LEADER 00000caa a22000002c 4500
001 1823674372
003 DE-627
005 20240326080313.0
007 cr uuu---uuuuu
008 221125s2022 xx |||||o 00| ||eng c
024 7 |a 10.1097/RLI.0000000000000878  |2 doi 
035 |a (DE-627)1823674372 
035 |a (DE-599)KXP1823674372 
035 |a (OCoLC)1361670521 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
084 |a 33  |2 sdnb 
100 1 |a Zhang, Kevin Sun  |e VerfasserIn  |0 (DE-588)1207581461  |0 (DE-627)1694082342  |4 aut 
245 1 0 |a Pseudoprospective paraclinical interaction of radiology residents with a deep learning system for prostate cancer detection  |b experience, performance, and identification of the need for intermittent recalibration  |c Kevin Sun Zhang, Patrick Schelb, Nils Netzer, Anoshirwan Andrej Tavakoli, Myriam Keymling, Eckhard Wehrse, Robert Hog, Lukas Thomas Rotkopf, Markus Wennmann, Philip Alexander Glemser, Heidi Thierjung, Nikolaus von Knebel Doeberitz, Jens Kleesiek, Magdalena Görtz, Viktoria Schütz, Thomas Hielscher, Albrecht Stenzinger, Markus Hohenfellner, Heinz-Peter Schlemmer, Klaus Maier-Hein, David Bonekamp 
264 1 |c 2022 
300 |a 12 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 25.11.2022 
520 |a Objectives - The aim of this study was to estimate the prospective utility of a previously retrospectively validated convolutional neural network (CNN) for prostate cancer (PC) detection on prostate magnetic resonance imaging (MRI). - Materials and Methods - The biparametric (T2-weighted and diffusion-weighted) portion of clinical multiparametric prostate MRI from consecutive men included between November 2019 and September 2020 was fully automatically and individually analyzed by a CNN briefly after image acquisition (pseudoprospective design). Radiology residents performed 2 research Prostate Imaging Reporting and Data System (PI-RADS) assessments of the multiparametric dataset independent from clinical reporting (paraclinical design) before and after review of the CNN results and completed a survey. Presence of clinically significant PC was determined by the presence of an International Society of Urological Pathology grade 2 or higher PC on combined targeted and extended systematic transperineal MRI/transrectal ultrasound fusion biopsy. Sensitivities and specificities on a patient and prostate sextant basis were compared using the McNemar test and compared with the receiver operating characteristic (ROC) curve of CNN. Survey results were summarized as absolute counts and percentages. - Results - A total of 201 men were included. The CNN achieved an ROC area under the curve of 0.77 on a patient basis. Using PI-RADS ≥3-emulating probability threshold (c3), CNN had a patient-based sensitivity of 81.8% and specificity of 54.8%, not statistically different from the current clinical routine PI-RADS ≥4 assessment at 90.9% and 54.8%, respectively (P = 0.30/P = 1.0). In general, residents achieved similar sensitivity and specificity before and after CNN review. On a prostate sextant basis, clinical assessment possessed the highest ROC area under the curve of 0.82, higher than CNN (AUC = 0.76, P = 0.21) and significantly higher than resident performance before and after CNN review (AUC = 0.76 / 0.76, P ≤ 0.03). The resident survey indicated CNN to be helpful and clinically useful. - Conclusions - Pseudoprospective paraclinical integration of fully automated CNN-based detection of suspicious lesions on prostate multiparametric MRI was demonstrated and showed good acceptance among residents, whereas no significant improvement in resident performance was found. General CNN performance was preserved despite an observed shift in CNN calibration, identifying the requirement for continuous quality control and recalibration. 
700 1 |a Schelb, Patrick  |d 1994-  |e VerfasserIn  |0 (DE-588)1197061495  |0 (DE-627)1678864773  |4 aut 
700 1 |a Netzer, Nils  |e VerfasserIn  |0 (DE-588)1254537902  |0 (DE-627)1797012975  |4 aut 
700 1 |a Tavakoli, Andrej  |d 1987-  |e VerfasserIn  |0 (DE-588)118568624X  |0 (DE-627)1665044403  |4 aut 
700 1 |a Keymling, Myriam  |e VerfasserIn  |0 (DE-588)127338928X  |0 (DE-627)1823185029  |4 aut 
700 1 |a Wehrse, Eckhard  |d 1988-  |e VerfasserIn  |0 (DE-588)1246823055  |0 (DE-627)1779915950  |4 aut 
700 1 |a Hog, Robert  |e VerfasserIn  |0 (DE-588)1216974691  |0 (DE-627)1728639220  |4 aut 
700 1 |a Rotkopf, Lukas Thomas  |d 1992-  |e VerfasserIn  |0 (DE-588)1246822814  |0 (DE-627)1779915187  |4 aut 
700 1 |a Wennmann, Markus  |d 1992-  |e VerfasserIn  |0 (DE-588)1188436317  |0 (DE-627)1667380931  |4 aut 
700 1 |a Glemser, Philip  |e VerfasserIn  |0 (DE-588)1029777756  |0 (DE-627)734092520  |0 (DE-576)377624667  |4 aut 
700 1 |a Thierjung, Heidi  |d 1980-  |e VerfasserIn  |0 (DE-588)136944752  |0 (DE-627)588716162  |0 (DE-576)301357609  |4 aut 
700 1 |a Knebel Doeberitz, Nikolaus von  |d 1989-  |e VerfasserIn  |0 (DE-588)1237346886  |0 (DE-627)1764041062  |4 aut 
700 1 |a Kleesiek, Jens Philipp  |d 1977-  |e VerfasserIn  |0 (DE-588)132998076  |0 (DE-627)530080745  |0 (DE-576)299554465  |4 aut 
700 1 |a Görtz, Magdalena  |d 1992-  |e VerfasserIn  |0 (DE-588)1166813657  |0 (DE-627)1030681392  |0 (DE-576)510916600  |4 aut 
700 1 |a Schütz, Viktoria  |e VerfasserIn  |0 (DE-588)1183860021  |0 (DE-627)1663385335  |4 aut 
700 1 |a Hielscher, Thomas  |e VerfasserIn  |0 (DE-588)1159594791  |0 (DE-627)1022977768  |0 (DE-576)50506068X  |4 aut 
700 1 |a Stenzinger, Albrecht  |e VerfasserIn  |0 (DE-588)139606106  |0 (DE-627)703395238  |0 (DE-576)312432755  |4 aut 
700 1 |a Hohenfellner, Markus  |d 1958-  |e VerfasserIn  |0 (DE-588)133862518  |0 (DE-627)557857988  |0 (DE-576)300155263  |4 aut 
700 1 |a Schlemmer, Heinz-Peter  |d 1961-  |e VerfasserIn  |0 (DE-588)1025559967  |0 (DE-627)722927142  |0 (DE-576)17334805X  |4 aut 
700 1 |a Maier-Hein, Klaus H.  |d 1980-  |e VerfasserIn  |0 (DE-588)1100551875  |0 (DE-627)85946461X  |0 (DE-576)333771222  |4 aut 
700 1 |a Bonekamp, David  |d 1977-  |e VerfasserIn  |0 (DE-588)128868104  |0 (DE-627)383668581  |0 (DE-576)297371797  |4 aut 
773 0 8 |i Enthalten in  |t Investigative radiology  |d Philadelphia, Pa. : Lippincott Williams & Wilkins, 1966  |g 57(2022), 9, Seite 601-612  |h Online-Ressource  |w (DE-627)326645322  |w (DE-600)2041543-6  |w (DE-576)09442568X  |x 1536-0210  |7 nnas  |a Pseudoprospective paraclinical interaction of radiology residents with a deep learning system for prostate cancer detection experience, performance, and identification of the need for intermittent recalibration 
773 1 8 |g volume:57  |g year:2022  |g number:9  |g pages:601-612  |g extent:12  |a Pseudoprospective paraclinical interaction of radiology residents with a deep learning system for prostate cancer detection experience, performance, and identification of the need for intermittent recalibration 
856 4 0 |u https://doi.org/10.1097/RLI.0000000000000878  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://journals.lww.com/investigativeradiology/Abstract/2022/09000/Pseudoprospective_Paraclinical_Interaction_of.6.aspx  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20221125 
992 |a 20221125 
993 |a Article 
994 |a 2022 
994 |a 2022 
998 |g 128868104  |a Bonekamp, David  |m 128868104:Bonekamp, David  |d 50000  |e 50000PB128868104  |k 0/50000/  |p 21  |y j 
998 |g 1100551875  |a Maier-Hein, Klaus H.  |m 1100551875:Maier-Hein, Klaus H.  |d 910000  |d 911400  |e 910000PM1100551875  |e 911400PM1100551875  |k 0/910000/  |k 1/910000/911400/  |p 20 
998 |g 1025559967  |a Schlemmer, Heinz-Peter  |m 1025559967:Schlemmer, Heinz-Peter  |d 60000  |e 60000PS1025559967  |k 0/60000/  |p 19 
998 |g 133862518  |a Hohenfellner, Markus  |m 133862518:Hohenfellner, Markus  |d 910000  |d 910200  |e 910000PH133862518  |e 910200PH133862518  |k 0/910000/  |k 1/910000/910200/  |p 18 
998 |g 139606106  |a Stenzinger, Albrecht  |m 139606106:Stenzinger, Albrecht  |d 910000  |d 912000  |e 910000PS139606106  |e 912000PS139606106  |k 0/910000/  |k 1/910000/912000/  |p 17 
998 |g 1159594791  |a Hielscher, Thomas  |m 1159594791:Hielscher, Thomas  |d 140000  |e 140000PH1159594791  |k 0/140000/  |p 16 
998 |g 1183860021  |a Schütz, Viktoria  |m 1183860021:Schütz, Viktoria  |d 910000  |d 910200  |e 910000PS1183860021  |e 910200PS1183860021  |k 0/910000/  |k 1/910000/910200/  |p 15 
998 |g 1166813657  |a Görtz, Magdalena  |m 1166813657:Görtz, Magdalena  |d 910000  |d 910200  |e 910000PG1166813657  |e 910200PG1166813657  |k 0/910000/  |k 1/910000/910200/  |p 14 
998 |g 132998076  |a Kleesiek, Jens Philipp  |m 132998076:Kleesiek, Jens Philipp  |d 50000  |e 50000PK132998076  |k 0/50000/  |p 13 
998 |g 1237346886  |a Knebel Doeberitz, Nikolaus von  |m 1237346886:Knebel Doeberitz, Nikolaus von  |p 12 
998 |g 136944752  |a Thierjung, Heidi  |m 136944752:Thierjung, Heidi  |p 11 
998 |g 1029777756  |a Glemser, Philip  |m 1029777756:Glemser, Philip  |d 50000  |e 50000PG1029777756  |k 0/50000/  |p 10 
998 |g 1188436317  |a Wennmann, Markus  |m 1188436317:Wennmann, Markus  |d 50000  |e 50000PW1188436317  |k 0/50000/  |p 9 
998 |g 1246822814  |a Rotkopf, Lukas Thomas  |m 1246822814:Rotkopf, Lukas Thomas  |p 8 
998 |g 1216974691  |a Hog, Robert  |m 1216974691:Hog, Robert  |d 50000  |e 50000PH1216974691  |k 0/50000/  |p 7 
998 |g 1246823055  |a Wehrse, Eckhard  |m 1246823055:Wehrse, Eckhard  |d 50000  |e 50000PW1246823055  |k 0/50000/  |p 6 
998 |g 127338928X  |a Keymling, Myriam  |m 127338928X:Keymling, Myriam  |d 60000  |e 60000PK127338928X  |k 0/60000/  |p 5 
998 |g 118568624X  |a Tavakoli, Andrej  |m 118568624X:Tavakoli, Andrej  |d 50000  |e 50000PT118568624X  |k 0/50000/  |p 4 
998 |g 1197061495  |a Schelb, Patrick  |m 1197061495:Schelb, Patrick  |d 50000  |e 50000PS1197061495  |k 0/50000/  |p 2 
998 |g 1207581461  |a Zhang, Kevin Sun  |m 1207581461:Zhang, Kevin Sun  |d 50000  |e 50000PZ1207581461  |k 0/50000/  |p 1  |x j 
999 |a KXP-PPN1823674372  |e 4219593780 
999 |a KXP-PPN1823674372  |e 4219588965 
BIB |a Y 
SER |a journal 
JSO |a {"language":["eng"],"person":[{"display":"Zhang, Kevin Sun","family":"Zhang","role":"aut","given":"Kevin Sun"},{"family":"Schelb","display":"Schelb, Patrick","role":"aut","given":"Patrick"},{"display":"Netzer, Nils","family":"Netzer","given":"Nils","role":"aut"},{"family":"Tavakoli","display":"Tavakoli, Andrej","given":"Andrej","role":"aut"},{"display":"Keymling, Myriam","family":"Keymling","role":"aut","given":"Myriam"},{"family":"Wehrse","display":"Wehrse, Eckhard","role":"aut","given":"Eckhard"},{"family":"Hog","display":"Hog, Robert","role":"aut","given":"Robert"},{"given":"Lukas Thomas","role":"aut","family":"Rotkopf","display":"Rotkopf, Lukas Thomas"},{"display":"Wennmann, Markus","family":"Wennmann","given":"Markus","role":"aut"},{"display":"Glemser, Philip","family":"Glemser","given":"Philip","role":"aut"},{"family":"Thierjung","display":"Thierjung, Heidi","role":"aut","given":"Heidi"},{"family":"Knebel Doeberitz","display":"Knebel Doeberitz, Nikolaus von","role":"aut","given":"Nikolaus von"},{"display":"Kleesiek, Jens Philipp","family":"Kleesiek","given":"Jens Philipp","role":"aut"},{"given":"Magdalena","role":"aut","display":"Görtz, Magdalena","family":"Görtz"},{"given":"Viktoria","role":"aut","display":"Schütz, Viktoria","family":"Schütz"},{"given":"Thomas","role":"aut","family":"Hielscher","display":"Hielscher, Thomas"},{"family":"Stenzinger","display":"Stenzinger, Albrecht","given":"Albrecht","role":"aut"},{"display":"Hohenfellner, Markus","family":"Hohenfellner","role":"aut","given":"Markus"},{"family":"Schlemmer","display":"Schlemmer, Heinz-Peter","given":"Heinz-Peter","role":"aut"},{"display":"Maier-Hein, Klaus H.","family":"Maier-Hein","given":"Klaus H.","role":"aut"},{"display":"Bonekamp, David","family":"Bonekamp","role":"aut","given":"David"}],"relHost":[{"recId":"326645322","physDesc":[{"extent":"Online-Ressource"}],"id":{"eki":["326645322"],"issn":["1536-0210"],"zdb":["2041543-6"]},"title":[{"subtitle":"a journal of clinical and laboratory research","title_sort":"Investigative radiology","title":"Investigative radiology"}],"note":["Gesehen am 01.03.11"],"origin":[{"publisherPlace":"Philadelphia, Pa. ; [Erscheinungsort nicht ermittelbar]","dateIssuedDisp":"1966-","dateIssuedKey":"1966","publisher":"Lippincott Williams & Wilkins ; Ovid"}],"pubHistory":["1.1966 -"],"type":{"media":"Online-Ressource","bibl":"periodical"},"disp":"Pseudoprospective paraclinical interaction of radiology residents with a deep learning system for prostate cancer detection experience, performance, and identification of the need for intermittent recalibrationInvestigative radiology","language":["eng"],"part":{"year":"2022","pages":"601-612","text":"57(2022), 9, Seite 601-612","issue":"9","volume":"57","extent":"12"}}],"recId":"1823674372","physDesc":[{"extent":"12 S."}],"name":{"displayForm":["Kevin Sun Zhang, Patrick Schelb, Nils Netzer, Anoshirwan Andrej Tavakoli, Myriam Keymling, Eckhard Wehrse, Robert Hog, Lukas Thomas Rotkopf, Markus Wennmann, Philip Alexander Glemser, Heidi Thierjung, Nikolaus von Knebel Doeberitz, Jens Kleesiek, Magdalena Görtz, Viktoria Schütz, Thomas Hielscher, Albrecht Stenzinger, Markus Hohenfellner, Heinz-Peter Schlemmer, Klaus Maier-Hein, David Bonekamp"]},"id":{"eki":["1823674372"],"doi":["10.1097/RLI.0000000000000878"]},"title":[{"subtitle":"experience, performance, and identification of the need for intermittent recalibration","title_sort":"Pseudoprospective paraclinical interaction of radiology residents with a deep learning system for prostate cancer detection","title":"Pseudoprospective paraclinical interaction of radiology residents with a deep learning system for prostate cancer detection"}],"note":["Gesehen am 25.11.2022"],"origin":[{"dateIssuedKey":"2022","dateIssuedDisp":"2022"}],"type":{"media":"Online-Ressource","bibl":"article-journal"}} 
SRT |a ZHANGKEVINPSEUDOPROS2022