Integrating patient data into skin cancer classification using convolutional neural networks: systematic review
Background: Recent years have been witnessing a substantial improvement in the accuracy of skin cancer classification using convolutional neural networks (CNNs). CNNs perform on par with or better than dermatologists with respect to the classification tasks of single images. However, in clinical pra...
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
2.7.2021
|
| In: |
Journal of medical internet research
Year: 2021, Volume: 23, Issue: 7, Pages: 1-14 |
| ISSN: | 1438-8871 |
| DOI: | 10.2196/20708 |
| Online Access: | Verlag, lizenzpflichtig, Volltext: https://doi.org/10.2196/20708 Verlag, lizenzpflichtig, Volltext: https://www.jmir.org/2021/7/e20708 
|
| Author Notes: | Julia Höhn, MSc; Achim Hekler, MSc; Eva Krieghoff-Henning, PhD; Jakob Nikolas Kather, Prof Dr med; Jochen Sven Utikal, Prof Dr med; Friedegund Meier, Univ Prof Dr med; Frank Friedrich Gellrich, Axel Hauschild, Dr med; Lars French, Dr med; Justin Gabriel Schlager, Dr med; Kamran Ghoreschi, Dr med; Tabea Wilhelm, Dr med; Heinz Kutzner, Dr med; Markus Heppt, PD Dr med; Sebastian Haferkamp, PD Dr med; Wiebke Sondermann, Dr med; Dirk Schadendorf, Dr med; Bastian Schilling, Dr med; Roman C. Maron, MSc; Max Schmitt, MSc; Tanja Jutzi, PhD; Stefan Fröhling, Prof Dr med; Daniel B. Lipka, PD Dr med; Titus Josef Brinker, Dr med, MD |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1773371185 | ||
| 003 | DE-627 | ||
| 005 | 20230428030156.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 211012s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.2196/20708 |2 doi | |
| 035 | |a (DE-627)1773371185 | ||
| 035 | |a (DE-599)KXP1773371185 | ||
| 035 | |a (OCoLC)1341421495 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Höhn, Julia |e VerfasserIn |0 (DE-588)1236930169 |0 (DE-627)1762751291 |4 aut | |
| 245 | 1 | 0 | |a Integrating patient data into skin cancer classification using convolutional neural networks |b systematic review |c Julia Höhn, MSc; Achim Hekler, MSc; Eva Krieghoff-Henning, PhD; Jakob Nikolas Kather, Prof Dr med; Jochen Sven Utikal, Prof Dr med; Friedegund Meier, Univ Prof Dr med; Frank Friedrich Gellrich, Axel Hauschild, Dr med; Lars French, Dr med; Justin Gabriel Schlager, Dr med; Kamran Ghoreschi, Dr med; Tabea Wilhelm, Dr med; Heinz Kutzner, Dr med; Markus Heppt, PD Dr med; Sebastian Haferkamp, PD Dr med; Wiebke Sondermann, Dr med; Dirk Schadendorf, Dr med; Bastian Schilling, Dr med; Roman C. Maron, MSc; Max Schmitt, MSc; Tanja Jutzi, PhD; Stefan Fröhling, Prof Dr med; Daniel B. Lipka, PD Dr med; Titus Josef Brinker, Dr med, MD |
| 264 | 1 | |c 2.7.2021 | |
| 300 | |a 14 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 12.10.2021 | ||
| 520 | |a Background: Recent years have been witnessing a substantial improvement in the accuracy of skin cancer classification using convolutional neural networks (CNNs). CNNs perform on par with or better than dermatologists with respect to the classification tasks of single images. However, in clinical practice, dermatologists also use other patient data beyond the visual aspects present in a digitized image, further increasing their diagnostic accuracy. Several pilot studies have recently investigated the effects of integrating different subtypes of patient data into CNN-based skin cancer classifiers. - Objective: This systematic review focuses on the current research investigating the impact of merging information from image features and patient data on the performance of CNN-based skin cancer image classification. This study aims to explore the potential in this field of research by evaluating the types of patient data used, the ways in which the nonimage data are encoded and merged with the image features, and the impact of the integration on the classifier performance. - Methods: Google Scholar, PubMed, MEDLINE, and ScienceDirect were screened for peer-reviewed studies published in English that dealt with the integration of patient data within a CNN-based skin cancer classification. The search terms skin cancer classification, convolutional neural network(s), deep learning, lesions, melanoma, metadata, clinical information, and patient data were combined. - Results: A total of 11 publications fulfilled the inclusion criteria. All of them reported an overall improvement in different skin lesion classification tasks with patient data integration. The most commonly used patient data were age, sex, and lesion location. The patient data were mostly one-hot encoded. There were differences in the complexity that the encoded patient data were processed with regarding deep learning methods before and after fusing them with the image features for a combined classifier. - Conclusions: This study indicates the potential benefits of integrating patient data into CNN-based diagnostic algorithms. However, how exactly the individual patient data enhance classification performance, especially in the case of multiclass classification problems, is still unclear. Moreover, a substantial fraction of patient data used by dermatologists remains to be analyzed in the context of CNN-based skin cancer classification. Further exploratory analyses in this promising field may optimize patient data integration into CNN-based skin cancer diagnostics for patients’ benefits. | ||
| 700 | 1 | |a Hekler, Achim |e VerfasserIn |0 (DE-588)1196829314 |0 (DE-627)1678721344 |4 aut | |
| 700 | 1 | |a Krieghoff-Henning, Eva |d 1976- |e VerfasserIn |0 (DE-588)132407914 |0 (DE-627)52267786X |0 (DE-576)299126706 |4 aut | |
| 700 | 1 | |a Kather, Jakob Nikolas |d 1989- |e VerfasserIn |0 (DE-588)1064064914 |0 (DE-627)812897587 |0 (DE-576)423589091 |4 aut | |
| 700 | 1 | |a Utikal, Jochen |d 1974- |e VerfasserIn |0 (DE-588)1026463750 |0 (DE-627)726765015 |0 (DE-576)371816580 |4 aut | |
| 700 | 1 | |a Meier, Friedegund |d 1960- |e VerfasserIn |0 (DE-588)124970184 |0 (DE-627)369238672 |0 (DE-576)294594825 |4 aut | |
| 700 | 1 | |a Gellrich, Frank Friedrich |d 1990- |e VerfasserIn |0 (DE-588)123548162X |0 (DE-627)1760486523 |4 aut | |
| 700 | 1 | |a Hauschild, Axel |e VerfasserIn |0 (DE-588)120701200 |0 (DE-627)080838448 |0 (DE-576)292346670 |4 aut | |
| 700 | 1 | |a French, Lars E. |d 1963- |e VerfasserIn |0 (DE-588)141166835 |0 (DE-627)70389966X |0 (DE-576)322518792 |4 aut | |
| 700 | 1 | |a Schlager, Justin Gabriel |d 1987- |e VerfasserIn |0 (DE-588)1119171520 |0 (DE-627)872683915 |0 (DE-576)479749930 |4 aut | |
| 700 | 1 | |a Ghoreschi, Kamran |d 1970- |e VerfasserIn |0 (DE-588)124466079 |0 (DE-627)363367357 |0 (DE-576)294184988 |4 aut | |
| 700 | 1 | |a Wilhelm, Tabea |e VerfasserIn |4 aut | |
| 700 | 1 | |a Kutzner, Heinz |e VerfasserIn |0 (DE-588)1207300756 |0 (DE-627)1693511363 |4 aut | |
| 700 | 1 | |a Heppt, Markus V. |d 1987- |e VerfasserIn |0 (DE-588)1072242346 |0 (DE-627)827081111 |0 (DE-576)43371767X |4 aut | |
| 700 | 1 | |a Haferkamp, Sebastian |d 1978- |e VerfasserIn |0 (DE-588)132018330 |0 (DE-627)51684296X |0 (DE-576)298896044 |4 aut | |
| 700 | 1 | |a Sondermann, Wiebke |e VerfasserIn |0 (DE-588)1198953756 |0 (DE-627)1681162121 |4 aut | |
| 700 | 1 | |a Schadendorf, Dirk |d 1960- |e VerfasserIn |0 (DE-588)11142576X |0 (DE-627)499566076 |0 (DE-576)289702275 |4 aut | |
| 700 | 1 | |a Schilling, Bastian |d 1979- |e VerfasserIn |0 (DE-588)142513563 |0 (DE-627)704247887 |0 (DE-576)331358913 |4 aut | |
| 700 | 1 | |a Maron, Roman C. |e VerfasserIn |0 (DE-588)1198959851 |0 (DE-627)1681173867 |4 aut | |
| 700 | 1 | |a Schmitt, Max |e VerfasserIn |0 (DE-588)1236577469 |0 (DE-627)1761961586 |4 aut | |
| 700 | 1 | |a Jutzi, Tanja |e VerfasserIn |4 aut | |
| 700 | 1 | |a Fröhling, Stefan |d 1969- |e VerfasserIn |0 (DE-588)120890046 |0 (DE-627)080950302 |0 (DE-576)188733930 |4 aut | |
| 700 | 1 | |a Lipka, Daniel |d 1976- |e VerfasserIn |0 (DE-588)131915312 |0 (DE-627)516076426 |0 (DE-576)298833328 |4 aut | |
| 700 | 1 | |a Brinker, Titus Josef |d 1990- |e VerfasserIn |0 (DE-588)1156309395 |0 (DE-627)1018860487 |0 (DE-576)502097434 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of medical internet research |d Richmond, Va. : Healthcare World, 1999 |g 23(2021), 7, Artikel-ID e20708, Seite 1-14 |h Online-Ressource |w (DE-627)324614136 |w (DE-600)2028830-X |w (DE-576)281198233 |x 1438-8871 |7 nnas |a Integrating patient data into skin cancer classification using convolutional neural networks systematic review |
| 773 | 1 | 8 | |g volume:23 |g year:2021 |g number:7 |g elocationid:e20708 |g pages:1-14 |g extent:14 |a Integrating patient data into skin cancer classification using convolutional neural networks systematic review |
| 856 | 4 | 0 | |u https://doi.org/10.2196/20708 |x Verlag |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 856 | 4 | 0 | |u https://www.jmir.org/2021/7/e20708 |x Verlag |z lizenzpflichtig |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20211012 | ||
| 993 | |a Article | ||
| 994 | |a 2021 | ||
| 998 | |g 1026463750 |a Utikal, Jochen |m 1026463750:Utikal, Jochen |d 60000 |e 60000PU1026463750 |k 0/60000/ |p 5 | ||
| 998 | |g 1156309395 |a Brinker, Titus Josef |m 1156309395:Brinker, Titus Josef |d 50000 |e 50000PB1156309395 |k 0/50000/ |p 24 |y j | ||
| 998 | |g 131915312 |a Lipka, Daniel |m 131915312:Lipka, Daniel |d 140000 |e 140000PL131915312 |k 0/140000/ |p 23 | ||
| 998 | |g 120890046 |a Fröhling, Stefan |m 120890046:Fröhling, Stefan |d 50000 |e 50000PF120890046 |k 0/50000/ |p 22 | ||
| 998 | |g 11142576X |a Schadendorf, Dirk |m 11142576X:Schadendorf, Dirk |d 50000 |e 50000PS11142576X |k 0/50000/ |p 27 | ||
| 998 | |g 1064064914 |a Kather, Jakob Nikolas |m 1064064914:Kather, Jakob Nikolas |d 910000 |d 910100 |e 910000PK1064064914 |e 910100PK1064064914 |k 0/910000/ |k 1/910000/910100/ |p 4 | ||
| 999 | |a KXP-PPN1773371185 |e 3988533858 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"name":{"displayForm":["Julia Höhn, MSc; Achim Hekler, MSc; Eva Krieghoff-Henning, PhD; Jakob Nikolas Kather, Prof Dr med; Jochen Sven Utikal, Prof Dr med; Friedegund Meier, Univ Prof Dr med; Frank Friedrich Gellrich, Axel Hauschild, Dr med; Lars French, Dr med; Justin Gabriel Schlager, Dr med; Kamran Ghoreschi, Dr med; Tabea Wilhelm, Dr med; Heinz Kutzner, Dr med; Markus Heppt, PD Dr med; Sebastian Haferkamp, PD Dr med; Wiebke Sondermann, Dr med; Dirk Schadendorf, Dr med; Bastian Schilling, Dr med; Roman C. Maron, MSc; Max Schmitt, MSc; Tanja Jutzi, PhD; Stefan Fröhling, Prof Dr med; Daniel B. Lipka, PD Dr med; Titus Josef Brinker, Dr med, MD"]},"id":{"doi":["10.2196/20708"],"eki":["1773371185"]},"origin":[{"dateIssuedKey":"2021","dateIssuedDisp":"2.7.2021"}],"person":[{"family":"Höhn","given":"Julia","role":"aut","display":"Höhn, Julia"},{"family":"Hekler","given":"Achim","role":"aut","display":"Hekler, Achim"},{"family":"Krieghoff-Henning","given":"Eva","role":"aut","display":"Krieghoff-Henning, Eva"},{"role":"aut","given":"Jakob Nikolas","family":"Kather","display":"Kather, Jakob Nikolas"},{"display":"Utikal, Jochen","role":"aut","given":"Jochen","family":"Utikal"},{"display":"Meier, Friedegund","family":"Meier","role":"aut","given":"Friedegund"},{"family":"Gellrich","role":"aut","given":"Frank Friedrich","display":"Gellrich, Frank Friedrich"},{"role":"aut","given":"Axel","family":"Hauschild","display":"Hauschild, Axel"},{"display":"French, Lars E.","given":"Lars E.","role":"aut","family":"French"},{"display":"Schlager, Justin Gabriel","family":"Schlager","role":"aut","given":"Justin Gabriel"},{"display":"Ghoreschi, Kamran","family":"Ghoreschi","given":"Kamran","role":"aut"},{"display":"Wilhelm, Tabea","family":"Wilhelm","role":"aut","given":"Tabea"},{"family":"Kutzner","role":"aut","given":"Heinz","display":"Kutzner, Heinz"},{"given":"Markus V.","role":"aut","family":"Heppt","display":"Heppt, Markus V."},{"family":"Haferkamp","role":"aut","given":"Sebastian","display":"Haferkamp, Sebastian"},{"display":"Sondermann, Wiebke","role":"aut","given":"Wiebke","family":"Sondermann"},{"family":"Schadendorf","role":"aut","given":"Dirk","display":"Schadendorf, Dirk"},{"role":"aut","given":"Bastian","family":"Schilling","display":"Schilling, Bastian"},{"display":"Maron, Roman C.","family":"Maron","role":"aut","given":"Roman C."},{"display":"Schmitt, Max","given":"Max","role":"aut","family":"Schmitt"},{"display":"Jutzi, Tanja","family":"Jutzi","given":"Tanja","role":"aut"},{"display":"Fröhling, Stefan","role":"aut","given":"Stefan","family":"Fröhling"},{"family":"Lipka","role":"aut","given":"Daniel","display":"Lipka, Daniel"},{"family":"Brinker","given":"Titus Josef","role":"aut","display":"Brinker, Titus Josef"}],"relHost":[{"disp":"Integrating patient data into skin cancer classification using convolutional neural networks systematic reviewJournal of medical internet research","physDesc":[{"extent":"Online-Ressource"}],"recId":"324614136","language":["eng"],"type":{"bibl":"periodical","media":"Online-Ressource"},"part":{"volume":"23","year":"2021","issue":"7","extent":"14","text":"23(2021), 7, Artikel-ID e20708, Seite 1-14","pages":"1-14"},"title":[{"subtitle":"international scientific journal for medical research, information and communication on the internet ; JMIR","title":"Journal of medical internet research","title_sort":"Journal of medical internet research"}],"id":{"zdb":["2028830-X"],"issn":["1438-8871"],"eki":["324614136"]},"pubHistory":["1.1999 -"],"titleAlt":[{"title":"JMIR"}],"origin":[{"dateIssuedDisp":"1999-","dateIssuedKey":"1999","publisherPlace":"Richmond, Va.","publisher":"Healthcare World"}]}],"type":{"media":"Online-Ressource","bibl":"article-journal"},"language":["eng"],"note":["Gesehen am 12.10.2021"],"title":[{"subtitle":"systematic review","title_sort":"Integrating patient data into skin cancer classification using convolutional neural networks","title":"Integrating patient data into skin cancer classification using convolutional neural networks"}],"physDesc":[{"extent":"14 S."}],"recId":"1773371185"} | ||
| SRT | |a HOEHNJULIAINTEGRATIN2720 | ||