Comparing artificial intelligence algorithms to 157 German dermatologists: the melanoma classification benchmark
Background - Several recent publications have demonstrated the use of convolutional neural networks to classify images of melanoma at par with board-certified dermatologists. However, the non-availability of a public human benchmark restricts the comparability of the performance of these algorithms...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
22 February 2019
|
| In: |
European journal of cancer
Year: 2019, Jahrgang: 111, Pages: 30-37 |
| ISSN: | 1879-0852 |
| DOI: | 10.1016/j.ejca.2018.12.016 |
| Online-Zugang: | Verlag, kostenfrei: https://doi.org/10.1016/j.ejca.2018.12.016 Verlag, Volltext: http://www.sciencedirect.com/science/article/pii/S0959804918315624 
|
| Verfasserangaben: | Titus J. Brinker, Achim Hekler, Axel Hauschild, Carola Berking, Bastian Schilling, Alexander H. Enk, Sebastian Haferkamp, Ante Karoglan, Christof von Kalle, Michael Weichenthal, Elke Sattler, Dirk Schadendorf, Maria R. Gaiser, Joachim Klode, Jochen S. Utikal |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1663654581 | ||
| 003 | DE-627 | ||
| 005 | 20240323101133.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 190426s2019 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.ejca.2018.12.016 |2 doi | |
| 035 | |a (DE-627)1663654581 | ||
| 035 | |a (DE-599)KXP1663654581 | ||
| 035 | |a (OCoLC)1341211920 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Brinker, Titus Josef |d 1990- |e VerfasserIn |0 (DE-588)1156309395 |0 (DE-627)1018860487 |0 (DE-576)502097434 |4 aut | |
| 245 | 1 | 0 | |a Comparing artificial intelligence algorithms to 157 German dermatologists |b the melanoma classification benchmark |c Titus J. Brinker, Achim Hekler, Axel Hauschild, Carola Berking, Bastian Schilling, Alexander H. Enk, Sebastian Haferkamp, Ante Karoglan, Christof von Kalle, Michael Weichenthal, Elke Sattler, Dirk Schadendorf, Maria R. Gaiser, Joachim Klode, Jochen S. Utikal |
| 264 | 1 | |c 22 February 2019 | |
| 300 | |a 8 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 26.04.2019 | ||
| 520 | |a Background - Several recent publications have demonstrated the use of convolutional neural networks to classify images of melanoma at par with board-certified dermatologists. However, the non-availability of a public human benchmark restricts the comparability of the performance of these algorithms and thereby the technical progress in this field. - Methods - An electronic questionnaire was sent to dermatologists at 12 German university hospitals. Each questionnaire comprised 100 dermoscopic and 100 clinical images (80 nevi images and 20 biopsy-verified melanoma images, each), all open-source. The questionnaire recorded factors such as the years of experience in dermatology, performed skin checks, age, sex and the rank within the university hospital or the status as resident physician. For each image, the dermatologists were asked to provide a management decision (treat/biopsy lesion or reassure the patient). Main outcome measures were sensitivity, specificity and the receiver operating characteristics (ROC). - Results - Total 157 dermatologists assessed all 100 dermoscopic images with an overall sensitivity of 74.1%, specificity of 60.0% and an ROC of 0.67 (range = 0.538-0.769); 145 dermatologists assessed all 100 clinical images with an overall sensitivity of 89.4%, specificity of 64.4% and an ROC of 0.769 (range = 0.613-0.9). Results between test-sets were significantly different (P < 0.05) confirming the need for a standardised benchmark. - Conclusions - We present the first public melanoma classification benchmark for both non-dermoscopic and dermoscopic images for comparing artificial intelligence algorithms with diagnostic performance of 145 or 157 dermatologists. Melanoma Classification Benchmark should be considered as a reference standard for white-skinned Western populations in the field of binary algorithmic melanoma classification. | ||
| 650 | 4 | |a Artificial intelligence | |
| 650 | 4 | |a Benchmark | |
| 650 | 4 | |a Deep learning | |
| 650 | 4 | |a Melanoma | |
| 700 | 1 | |a Hekler, Achim |e VerfasserIn |0 (DE-588)1196829314 |0 (DE-627)1678721344 |4 aut | |
| 700 | 1 | |a Hauschild, Axel |e VerfasserIn |0 (DE-588)120701200 |0 (DE-627)080838448 |0 (DE-576)292346670 |4 aut | |
| 700 | 1 | |a Berking, Carola |d 1971- |e VerfasserIn |0 (DE-588)115659714 |0 (DE-627)077390121 |0 (DE-576)290004942 |4 aut | |
| 700 | 1 | |a Schilling, Bastian |d 1979- |e VerfasserIn |0 (DE-588)142513563 |0 (DE-627)704247887 |0 (DE-576)331358913 |4 aut | |
| 700 | 1 | |a Enk, Alexander |d 1963- |e VerfasserIn |0 (DE-588)1032757140 |0 (DE-627)739272535 |0 (DE-576)166173517 |4 aut | |
| 700 | 1 | |a Haferkamp, Sebastian |d 1978- |e VerfasserIn |0 (DE-588)132018330 |0 (DE-627)51684296X |0 (DE-576)298896044 |4 aut | |
| 700 | 1 | |a Karoglan, Ante |d 1988- |e VerfasserIn |0 (DE-588)1193190177 |0 (DE-627)1671838203 |4 aut | |
| 700 | 1 | |a Kalle, Christof von |d 1962- |e VerfasserIn |0 (DE-588)1036481115 |0 (DE-627)75107926X |0 (DE-576)168957396 |4 aut | |
| 700 | 1 | |a Weichenthal, Michael |e VerfasserIn |0 (DE-588)140953272 |0 (DE-627)623003848 |0 (DE-576)321514157 |4 aut | |
| 700 | 1 | |a Sattler, Elke |e VerfasserIn |0 (DE-588)1047601796 |0 (DE-627)778655385 |0 (DE-576)401394409 |4 aut | |
| 700 | 1 | |a Schadendorf, Dirk |d 1960- |e VerfasserIn |0 (DE-588)11142576X |0 (DE-627)499566076 |0 (DE-576)289702275 |4 aut | |
| 700 | 1 | |a Gaiser, Maria |d 1979- |e VerfasserIn |0 (DE-588)1074971930 |0 (DE-627)832793035 |0 (DE-576)443175551 |4 aut | |
| 700 | 1 | |a Klode, Joachim |d 1974- |e VerfasserIn |0 (DE-588)137117906 |0 (DE-627)589937316 |0 (DE-576)302153314 |4 aut | |
| 700 | 1 | |a Utikal, Jochen |d 1974- |e VerfasserIn |0 (DE-588)1026463750 |0 (DE-627)726765015 |0 (DE-576)371816580 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t European journal of cancer |d Amsterdam [u.a.] : Elsevier, 1992 |g 111(2019), Seite 30-37 |w (DE-627)266883400 |w (DE-600)1468190-0 |w (DE-576)090954173 |x 1879-0852 |7 nnas |a Comparing artificial intelligence algorithms to 157 German dermatologists the melanoma classification benchmark |
| 773 | 1 | 8 | |g volume:111 |g year:2019 |g pages:30-37 |g extent:8 |a Comparing artificial intelligence algorithms to 157 German dermatologists the melanoma classification benchmark |
| 856 | 4 | 0 | |u https://doi.org/10.1016/j.ejca.2018.12.016 |x Verlag |x Resolving-System |z kostenfrei |
| 856 | 4 | 0 | |u http://www.sciencedirect.com/science/article/pii/S0959804918315624 |x Verlag |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20190426 | ||
| 993 | |a Article | ||
| 994 | |a 2019 | ||
| 998 | |g 1026463750 |a Utikal, Jochen |m 1026463750:Utikal, Jochen |d 60000 |e 60000PU1026463750 |k 0/60000/ |p 15 |y j | ||
| 998 | |g 11142576X |a Schadendorf, Dirk |m 11142576X:Schadendorf, Dirk |d 50000 |e 50000PS11142576X |k 0/50000/ |p 12 | ||
| 998 | |g 1036481115 |a Kalle, Christof von |m 1036481115:Kalle, Christof von |d 910000 |e 910000PK1036481115 |k 0/910000/ |p 9 | ||
| 998 | |g 1032757140 |a Enk, Alexander |m 1032757140:Enk, Alexander |d 910000 |d 911300 |e 910000PE1032757140 |e 911300PE1032757140 |k 0/910000/ |k 1/910000/911300/ |p 6 | ||
| 998 | |g 1156309395 |a Brinker, Titus Josef |m 1156309395:Brinker, Titus Josef |d 910000 |d 911300 |e 910000PB1156309395 |e 911300PB1156309395 |k 0/910000/ |k 1/910000/911300/ |p 1 |x j | ||
| 999 | |a KXP-PPN1663654581 |e 3453498410 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"physDesc":[{"extent":"8 S."}],"person":[{"role":"aut","display":"Brinker, Titus Josef","family":"Brinker","given":"Titus Josef"},{"given":"Achim","display":"Hekler, Achim","family":"Hekler","role":"aut"},{"role":"aut","given":"Axel","family":"Hauschild","display":"Hauschild, Axel"},{"family":"Berking","display":"Berking, Carola","given":"Carola","role":"aut"},{"role":"aut","given":"Bastian","display":"Schilling, Bastian","family":"Schilling"},{"role":"aut","display":"Enk, Alexander","family":"Enk","given":"Alexander"},{"family":"Haferkamp","display":"Haferkamp, Sebastian","given":"Sebastian","role":"aut"},{"role":"aut","family":"Karoglan","display":"Karoglan, Ante","given":"Ante"},{"role":"aut","given":"Christof von","family":"Kalle","display":"Kalle, Christof von"},{"family":"Weichenthal","display":"Weichenthal, Michael","given":"Michael","role":"aut"},{"family":"Sattler","display":"Sattler, Elke","given":"Elke","role":"aut"},{"role":"aut","display":"Schadendorf, Dirk","family":"Schadendorf","given":"Dirk"},{"family":"Gaiser","display":"Gaiser, Maria","given":"Maria","role":"aut"},{"display":"Klode, Joachim","family":"Klode","given":"Joachim","role":"aut"},{"given":"Jochen","display":"Utikal, Jochen","family":"Utikal","role":"aut"}],"title":[{"title":"Comparing artificial intelligence algorithms to 157 German dermatologists","subtitle":"the melanoma classification benchmark","title_sort":"Comparing artificial intelligence algorithms to 157 German dermatologists"}],"relHost":[{"disp":"Comparing artificial intelligence algorithms to 157 German dermatologists the melanoma classification benchmarkEuropean journal of cancer","pubHistory":["28.1992 -"],"note":["Gesehen am 21.03.24","Ungezählte Beil.: Supplement"],"recId":"266883400","origin":[{"dateIssuedDisp":"1992-","publisherPlace":"Amsterdam [u.a.] ; [Erscheinungsort nicht ermittelbar]","dateIssuedKey":"1992","publisher":"Elsevier ; Pergamon Press"}],"corporate":[{"display":"European Organization for Research on Treatment of Cancer","role":"isb"},{"role":"isb","display":"European Association for Cancer Research"},{"display":"European School of Oncology","role":"isb"}],"language":["eng"],"type":{"bibl":"periodical","media":"Online-Ressource"},"id":{"eki":["266883400"],"zdb":["1468190-0"],"issn":["1879-0852"]},"part":{"volume":"111","year":"2019","extent":"8","pages":"30-37","text":"111(2019), Seite 30-37"},"title":[{"title_sort":"European journal of cancer","title":"European journal of cancer"}],"titleAlt":[{"title":"EJC online"}]}],"id":{"eki":["1663654581"],"doi":["10.1016/j.ejca.2018.12.016"]},"type":{"bibl":"article-journal","media":"Online-Ressource"},"language":["eng"],"origin":[{"dateIssuedKey":"2019","dateIssuedDisp":"22 February 2019"}],"name":{"displayForm":["Titus J. Brinker, Achim Hekler, Axel Hauschild, Carola Berking, Bastian Schilling, Alexander H. Enk, Sebastian Haferkamp, Ante Karoglan, Christof von Kalle, Michael Weichenthal, Elke Sattler, Dirk Schadendorf, Maria R. Gaiser, Joachim Klode, Jochen S. Utikal"]},"note":["Gesehen am 26.04.2019"],"recId":"1663654581"} | ||
| SRT | |a BRINKERTITCOMPARINGA2220 | ||