Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classification
Background - Clinicians and pathologists traditionally use patient data in addition to clinical examination to support their diagnoses. - Objectives - We investigated whether a combination of histologic whole slides image (WSI) analysis based on convolutional neural networks (CNNs) and commonly avai...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
7 April 2021
|
| In: |
European journal of cancer
Year: 2021, Jahrgang: 149, Pages: 94-101 |
| ISSN: | 1879-0852 |
| DOI: | 10.1016/j.ejca.2021.02.032 |
| Online-Zugang: | Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1016/j.ejca.2021.02.032 Verlag, lizenzpflichtig, Volltext: https://www.sciencedirect.com/science/article/pii/S0959804921001404 
|
| Verfasserangaben: | Julia Höhn, Eva Krieghoff-Henning, Tanja B. Jutzi, Christof von Kalle, Jochen S. Utikal, Friedegund Meier, Frank F. Gellrich, Sarah Hobelsberger, Axel Hauschild, Justin G. Schlager, Lars French, Lucie Heinzerling, Max Schlaak, Kamran Ghoreschi, Franz J. Hilke, Gabriela Poch, Heinz Kutzner, Markus V. Heppt, Sebastian Haferkamp, Wiebke Sondermann, Dirk Schadendorf, Bastian Schilling, Matthias Goebeler, Achim Hekler, Stefan Fröhling, Daniel B. Lipka, Jakob N. Kather, Dieter Krahl, Gerardo Ferrara, Sarah Haggenmüller, Titus J. Brinker |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1762744287 | ||
| 003 | DE-627 | ||
| 005 | 20240414193232.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 210713s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.ejca.2021.02.032 |2 doi | |
| 035 | |a (DE-627)1762744287 | ||
| 035 | |a (DE-599)KXP1762744287 | ||
| 035 | |a (OCoLC)1341418352 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Höhn, Julia |e VerfasserIn |0 (DE-588)1236930169 |0 (DE-627)1762751291 |4 aut | |
| 245 | 1 | 0 | |a Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classification |c Julia Höhn, Eva Krieghoff-Henning, Tanja B. Jutzi, Christof von Kalle, Jochen S. Utikal, Friedegund Meier, Frank F. Gellrich, Sarah Hobelsberger, Axel Hauschild, Justin G. Schlager, Lars French, Lucie Heinzerling, Max Schlaak, Kamran Ghoreschi, Franz J. Hilke, Gabriela Poch, Heinz Kutzner, Markus V. Heppt, Sebastian Haferkamp, Wiebke Sondermann, Dirk Schadendorf, Bastian Schilling, Matthias Goebeler, Achim Hekler, Stefan Fröhling, Daniel B. Lipka, Jakob N. Kather, Dieter Krahl, Gerardo Ferrara, Sarah Haggenmüller, Titus J. Brinker |
| 264 | 1 | |c 7 April 2021 | |
| 300 | |a 8 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 13.07.2021 | ||
| 520 | |a Background - Clinicians and pathologists traditionally use patient data in addition to clinical examination to support their diagnoses. - Objectives - We investigated whether a combination of histologic whole slides image (WSI) analysis based on convolutional neural networks (CNNs) and commonly available patient data (age, sex and anatomical site of the lesion) in a binary melanoma/nevus classification task could increase the performance compared with CNNs alone. - Methods - We used 431 WSIs from two different laboratories and analysed the performance of classifiers that used the image or patient data individually or three common fusion techniques. Furthermore, we tested a naive combination of patient data and an image classifier: for cases interpreted as ‘uncertain’ (CNN output score <0.7), the decision of the CNN was replaced by the decision of the patient data classifier. - Results - The CNN on its own achieved the best performance (mean ± standard deviation of five individual runs) with AUROC of 92.30% ± 0.23% and balanced accuracy of 83.17% ± 0.38%. While the classification performance was not significantly improved in general by any of the tested fusions, naive strategy of replacing the image classifier with the patient data classifier on slides with low output scores improved balanced accuracy to 86.72% ± 0.36%. - Conclusion - In most cases, the CNN on its own was so accurate that patient data integration did not provide any benefit. However, incorporating patient data for lesions that were classified by the CNN with low ‘confidence’ improved balanced accuracy. | ||
| 650 | 4 | |a Convolutional neural networks | |
| 650 | 4 | |a Data fusion | |
| 650 | 4 | |a Histologic whole slide images | |
| 650 | 4 | |a Patient data | |
| 650 | 4 | |a Skin cancer classification | |
| 700 | 1 | |a Krieghoff-Henning, Eva |d 1976- |e VerfasserIn |0 (DE-588)132407914 |0 (DE-627)52267786X |0 (DE-576)299126706 |4 aut | |
| 700 | 1 | |a Jutzi, Tanja |e VerfasserIn |0 (DE-588)1234604825 |0 (DE-627)1759447528 |4 aut | |
| 700 | 1 | |a Kalle, Christof von |d 1962- |e VerfasserIn |0 (DE-588)1036481115 |0 (DE-627)75107926X |0 (DE-576)168957396 |4 aut | |
| 700 | 1 | |a Utikal, Jochen |d 1974- |e VerfasserIn |0 (DE-588)1026463750 |0 (DE-627)726765015 |0 (DE-576)371816580 |4 aut | |
| 700 | 1 | |a Meier, Friedegund |e VerfasserIn |4 aut | |
| 700 | 1 | |a Gellrich, Frank F. |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hobelsberger, Sarah |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hauschild, Axel |e VerfasserIn |4 aut | |
| 700 | 1 | |a Schlager, Justin G. |e VerfasserIn |4 aut | |
| 700 | 1 | |a French, Lars |e VerfasserIn |4 aut | |
| 700 | 1 | |a Heinzerling, Lucie |e VerfasserIn |4 aut | |
| 700 | 1 | |a Schlaak, Max |e VerfasserIn |4 aut | |
| 700 | 1 | |a Ghoreschi, Kamran |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hilke, Franz J. |e VerfasserIn |4 aut | |
| 700 | 1 | |a Poch, Gabriela |e VerfasserIn |4 aut | |
| 700 | 1 | |a Kutzner, Heinz |e VerfasserIn |4 aut | |
| 700 | 1 | |a Heppt, Markus V. |d 1987- |e VerfasserIn |0 (DE-588)1072242346 |0 (DE-627)827081111 |0 (DE-576)43371767X |4 aut | |
| 700 | 1 | |a Haferkamp, Sebastian |d 1978- |e VerfasserIn |0 (DE-588)132018330 |0 (DE-627)51684296X |0 (DE-576)298896044 |4 aut | |
| 700 | 1 | |a Sondermann, Wiebke |e VerfasserIn |0 (DE-588)1198953756 |0 (DE-627)1681162121 |4 aut | |
| 700 | 1 | |a Schadendorf, Dirk |d 1960- |e VerfasserIn |0 (DE-588)11142576X |0 (DE-627)499566076 |0 (DE-576)289702275 |4 aut | |
| 700 | 1 | |a Schilling, Bastian |d 1979- |e VerfasserIn |0 (DE-588)142513563 |0 (DE-627)704247887 |0 (DE-576)331358913 |4 aut | |
| 700 | 1 | |a Goebeler, Matthias |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hekler, Achim |e VerfasserIn |4 aut | |
| 700 | 1 | |a Fröhling, Stefan |d 1969- |e VerfasserIn |0 (DE-588)120890046 |0 (DE-627)080950302 |0 (DE-576)188733930 |4 aut | |
| 700 | 1 | |a Lipka, Daniel |d 1976- |e VerfasserIn |0 (DE-588)131915312 |0 (DE-627)516076426 |0 (DE-576)298833328 |4 aut | |
| 700 | 1 | |a Kather, Jakob Nikolas |d 1989- |e VerfasserIn |0 (DE-588)1064064914 |0 (DE-627)812897587 |0 (DE-576)423589091 |4 aut | |
| 700 | 1 | |a Krahl, Dieter |e VerfasserIn |4 aut | |
| 700 | 1 | |a Ferrara, Gerardo |e VerfasserIn |4 aut | |
| 700 | 1 | |a Haggenmüller, Sarah |d 1995- |e VerfasserIn |0 (DE-588)1231946709 |0 (DE-627)1755618042 |4 aut | |
| 700 | 1 | |a Brinker, Titus Josef |d 1990- |e VerfasserIn |0 (DE-588)1156309395 |0 (DE-627)1018860487 |0 (DE-576)502097434 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t European journal of cancer |d Amsterdam [u.a.] : Elsevier, 1992 |g 149(2021) vom: Mai, Seite 94-101 |w (DE-627)266883400 |w (DE-600)1468190-0 |w (DE-576)090954173 |x 1879-0852 |7 nnas |a Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classification |
| 773 | 1 | 8 | |g volume:149 |g year:2021 |g month:05 |g pages:94-101 |g extent:8 |a Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classification |
| 856 | 4 | 0 | |u https://doi.org/10.1016/j.ejca.2021.02.032 |x Verlag |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 856 | 4 | 0 | |u https://www.sciencedirect.com/science/article/pii/S0959804921001404 |x Verlag |z lizenzpflichtig |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20210713 | ||
| 993 | |a Article | ||
| 994 | |a 2021 | ||
| 998 | |g 1156309395 |a Brinker, Titus Josef |m 1156309395:Brinker, Titus Josef |d 50000 |e 50000PB1156309395 |k 0/50000/ |p 31 |y j | ||
| 998 | |g 1231946709 |a Haggenmüller, Sarah |m 1231946709:Haggenmüller, Sarah |d 60000 |e 60000PH1231946709 |k 0/60000/ |p 30 | ||
| 998 | |g 1064064914 |a Kather, Jakob Nikolas |m 1064064914:Kather, Jakob Nikolas |d 910000 |d 910100 |e 910000PK1064064914 |e 910100PK1064064914 |k 0/910000/ |k 1/910000/910100/ |p 27 | ||
| 998 | |g 131915312 |a Lipka, Daniel |m 131915312:Lipka, Daniel |d 140000 |e 140000PL131915312 |k 0/140000/ |p 26 | ||
| 998 | |g 120890046 |a Fröhling, Stefan |m 120890046:Fröhling, Stefan |d 50000 |e 50000PF120890046 |k 0/50000/ |p 25 | ||
| 998 | |g 11142576X |a Schadendorf, Dirk |m 11142576X:Schadendorf, Dirk |d 50000 |e 50000PS11142576X |k 0/50000/ |p 21 | ||
| 998 | |g 1026463750 |a Utikal, Jochen |m 1026463750:Utikal, Jochen |d 60000 |e 60000PU1026463750 |k 0/60000/ |p 5 | ||
| 998 | |g 1036481115 |a Kalle, Christof von |m 1036481115:Kalle, Christof von |d 50000 |e 50000PK1036481115 |k 0/50000/ |p 4 | ||
| 998 | |g 1234604825 |a Jutzi, Tanja |m 1234604825:Jutzi, Tanja |p 3 | ||
| 998 | |g 132407914 |a Krieghoff-Henning, Eva |m 132407914:Krieghoff-Henning, Eva |p 2 | ||
| 998 | |g 1236930169 |a Höhn, Julia |m 1236930169:Höhn, Julia |p 1 |x j | ||
| 999 | |a KXP-PPN1762744287 |e 3949472967 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"physDesc":[{"extent":"8 S."}],"recId":"1762744287","type":{"bibl":"article-journal","media":"Online-Ressource"},"language":["eng"],"note":["Gesehen am 13.07.2021"],"title":[{"title_sort":"Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classification","title":"Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classification"}],"origin":[{"dateIssuedKey":"2021","dateIssuedDisp":"7 April 2021"}],"person":[{"display":"Höhn, Julia","family":"Höhn","given":"Julia","role":"aut"},{"display":"Krieghoff-Henning, Eva","given":"Eva","role":"aut","family":"Krieghoff-Henning"},{"display":"Jutzi, Tanja","family":"Jutzi","role":"aut","given":"Tanja"},{"display":"Kalle, Christof von","role":"aut","given":"Christof von","family":"Kalle"},{"display":"Utikal, Jochen","given":"Jochen","role":"aut","family":"Utikal"},{"role":"aut","given":"Friedegund","family":"Meier","display":"Meier, Friedegund"},{"family":"Gellrich","role":"aut","given":"Frank F.","display":"Gellrich, Frank F."},{"family":"Hobelsberger","role":"aut","given":"Sarah","display":"Hobelsberger, Sarah"},{"given":"Axel","role":"aut","family":"Hauschild","display":"Hauschild, Axel"},{"family":"Schlager","given":"Justin G.","role":"aut","display":"Schlager, Justin G."},{"role":"aut","given":"Lars","family":"French","display":"French, Lars"},{"given":"Lucie","role":"aut","family":"Heinzerling","display":"Heinzerling, Lucie"},{"role":"aut","given":"Max","family":"Schlaak","display":"Schlaak, Max"},{"display":"Ghoreschi, Kamran","family":"Ghoreschi","role":"aut","given":"Kamran"},{"display":"Hilke, Franz J.","family":"Hilke","given":"Franz J.","role":"aut"},{"display":"Poch, Gabriela","role":"aut","given":"Gabriela","family":"Poch"},{"display":"Kutzner, Heinz","family":"Kutzner","given":"Heinz","role":"aut"},{"role":"aut","given":"Markus V.","family":"Heppt","display":"Heppt, Markus V."},{"display":"Haferkamp, Sebastian","family":"Haferkamp","role":"aut","given":"Sebastian"},{"family":"Sondermann","given":"Wiebke","role":"aut","display":"Sondermann, Wiebke"},{"role":"aut","given":"Dirk","family":"Schadendorf","display":"Schadendorf, Dirk"},{"display":"Schilling, Bastian","family":"Schilling","given":"Bastian","role":"aut"},{"family":"Goebeler","role":"aut","given":"Matthias","display":"Goebeler, Matthias"},{"given":"Achim","role":"aut","family":"Hekler","display":"Hekler, Achim"},{"display":"Fröhling, Stefan","role":"aut","given":"Stefan","family":"Fröhling"},{"display":"Lipka, Daniel","given":"Daniel","role":"aut","family":"Lipka"},{"display":"Kather, Jakob Nikolas","family":"Kather","role":"aut","given":"Jakob Nikolas"},{"display":"Krahl, Dieter","given":"Dieter","role":"aut","family":"Krahl"},{"display":"Ferrara, Gerardo","family":"Ferrara","given":"Gerardo","role":"aut"},{"display":"Haggenmüller, Sarah","family":"Haggenmüller","role":"aut","given":"Sarah"},{"family":"Brinker","role":"aut","given":"Titus Josef","display":"Brinker, Titus Josef"}],"relHost":[{"recId":"266883400","disp":"Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classificationEuropean journal of cancer","origin":[{"publisher":"Elsevier ; Pergamon Press","dateIssuedDisp":"1992-","dateIssuedKey":"1992","publisherPlace":"Amsterdam [u.a.] ; [Erscheinungsort nicht ermittelbar]"}],"note":["Gesehen am 21.03.24","Ungezählte Beil.: Supplement"],"language":["eng"],"type":{"bibl":"periodical","media":"Online-Ressource"},"title":[{"title_sort":"European journal of cancer","title":"European journal of cancer"}],"corporate":[{"role":"isb","display":"European Organization for Research on Treatment of Cancer"},{"display":"European Association for Cancer Research","role":"isb"},{"display":"European School of Oncology","role":"isb"}],"pubHistory":["28.1992 -"],"titleAlt":[{"title":"EJC online"}],"part":{"pages":"94-101","year":"2021","text":"149(2021) vom: Mai, Seite 94-101","volume":"149","extent":"8"},"id":{"issn":["1879-0852"],"eki":["266883400"],"zdb":["1468190-0"]}}],"id":{"doi":["10.1016/j.ejca.2021.02.032"],"eki":["1762744287"]},"name":{"displayForm":["Julia Höhn, Eva Krieghoff-Henning, Tanja B. Jutzi, Christof von Kalle, Jochen S. Utikal, Friedegund Meier, Frank F. Gellrich, Sarah Hobelsberger, Axel Hauschild, Justin G. Schlager, Lars French, Lucie Heinzerling, Max Schlaak, Kamran Ghoreschi, Franz J. Hilke, Gabriela Poch, Heinz Kutzner, Markus V. Heppt, Sebastian Haferkamp, Wiebke Sondermann, Dirk Schadendorf, Bastian Schilling, Matthias Goebeler, Achim Hekler, Stefan Fröhling, Daniel B. Lipka, Jakob N. Kather, Dieter Krahl, Gerardo Ferrara, Sarah Haggenmüller, Titus J. Brinker"]}} | ||
| SRT | |a HOEHNJULIACOMBININGC7202 | ||